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PREFACE 


This report documents the findings obtained from the DST 
Temperature Sounding Impact Test Project conducted at GISS between 
April 1976 and April 1977. The objective of the project was to 
determine the impact on weather forecasting that can result from 
operational use of temperature profiles obtained from satellite 
soundings . 

The project stemmed from the recommendation of an ad-hoc 
advisory committee that met at GISS in March 1976 to review the 
meteorological research program. The consensus of the committee 
was that among GISS meteorological programs, the sounder impact 
study had the highest priority, in terms of Agency objectives. 

Results from the project tests show the impact of sounding 
data to be substantial and beneficial for a one-month winter test 
period, according to all the verification criteria applied. 

Results for a two-week summer test period show positive impacts of 

/ ! 

considerably smaller magnitude with much less statistical signifi- 
cance. The magnitude of the monthly mean impact in the winter 
forecasts is comparable with that of improvements made in NMC 
operations over the past decade. 

The largest magnitude of the sounder data impact was obtained 
(1) using the combined data from two satellites and (2) applying 
a time-continuous four-dimensional assimilation procedure developed 
at GISS and based on statistical weighting ("optimal interpolation") 
of temperatures • Significantly smaller (but positive) forecast impacts 
resulted when conventional data assimilation methods were used. 



These sitialler positive impacts from conventional assimilation tech- 
niques agree in magnitude with results recently reported by NMC for 
this same DST period. 


This study leads us to believe that adoption of the GISS 
assimilation techniques^ plus operational use of simultaneous data 

from two satellites should result in a signifiaant inavease in the 
accuracy of 48 and 72 hour forecasts. 


Description of rxrimriEMT? 

Sounder Impact experiments were carried out for the DST-5 and 
DST-6 periods of Data System Testing. The periods over which the 
DST data were used extended from Aug. 18 through Sept. 4, 1975, for ' 
DST-5, and Jan. 29 through Feb. 21, 1976, for DST-6. The data sets 
contained all the conventional operational upper air and surface data 
collected by the National Meteorological Center in a ten-hour window 
about synoptic times, as well as special aircraft reports, cloud-tracked 
winds and temperature sounding data. The temperature sounding data sets 
included the NESS operational sounding data from the VTPR instrument on 
the NOAA-4 satellite and NESS-processed sounding profiles obtained from 
the HIRS and SCAMS instruments on the NIMBUS-6 satellite. 

Each impact experiment consisted of a distinct analysis/forecast 
cycle for the entire period. The same forecast model was used 
xn all the xmpact experiments .• The analysis scheme treated all the data 
identically in every experiment except for the handling of sounding 
temperature profiles. The basic cycle which serves as the control ex- 
periment is the "NO SAT" case and consisted of omitting all satellite 
sounding data. Every other experiment reported involved asynoptic assi~ 
milation of the sounding data within ten-minute intervals of the time of 


observation. Experiments differed from each other either in respect 
to the number of satellite sounders from which data were used or in 
the method by which the data were assimilated. In no experiment were 
the cloud— track wind data from the University of Wisconsin included 
in the study. 

Results of Experiments 

The major impact results summarized below are derived from the 
experiment in which optimal statistical weighting procedures were 
^PPlisd to the sounding data. The results are presented for the 48 
and 72 hour forecast comparisons using the GISS analysis technique 
and forecast model. 

The evaluation of the impact is assessed according to the 
following criteria: 

(i) Magnitudes and locations of initial-state differences 
in the analyzed fields produced with and without satellite data, 

(ii) Statistical measures of forecast accuracy (i.e., 
skill scores and rms errors) obtained from nvimerical integrations 
starting from the initial states prepared with and without satellite 
data; 

(iii) Verifications of local precipitation and surface 
temperature forecasts based on prognostic charts produced with and 
without satellite data. 
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The principal findings obtained for the winter test period 


• Satellite data generate large initial state differences in data 
sparse regions which lead in turn to significantly different forecasts. 

• Forecasts started fro™ initial states obtained with the aid of 
satellite data show a mean Improvement of about 4 points in the 48 and 
72-hour skill scores as verified over north America and Europe. 

This corresponds to an 8 tO 12 hnn-r • 

hour forecast improvement in the forecast 

range at 48 hours. 


a Satellite data lead to substantial differences in the 72 hour 
forecast errors over North America in 83% of the winter forecasts. Of 
these, 77% of the impacts were beneficial resulting in a 38-75% re- 
duction of errors at 500mb. 


• An automated local precipitation forecast model applied to 
128 cities in the United States showed an average 15% improvement 
when satellite data had been used for the numerical forecasts. Over 
the midwest, where the difficulties in modeling mountain and coastal 
effects can- be avoided in the precipitation model, there was a 75% 
improvement obtained from the use of satellite data. 

• The statistical impact of data from two satellites is greater 
than that from either satellite alone and is proportional to the com- 
bined sounding yield of both satellites. 

• satellite soundings do not systematically smooth potential 
temperature gradients. 
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In the coming year, more detailed studies of certain aspects of 
the data assimilation method are planned. In addition, similar tests 
will be conducted employing a higher resolution model. Among the 
problems which still require study and clarification are the removal 
of the statistical bias of satellite data, the treatment of the large- 
distance tail in the statistical covariance error function, the pro- 
pagation speed of disturbances in the model, and the effect of 
balancing techniques on initial states. From the outset of the 
project, many promising experiments had to be abandoned or deferred 
in order to meet the firm schedules leading to this report. It is 
hoped that some of these unfinished studies including the testing 
and operational use of GISS . derived sounder temperature profiles 
can be completed in time for FGGE. 

The instruments scheduled to become the operational system on 
TIROS-N are essentially the same as the present HIRS and SCAMS 
temperature sounders; it is expected therefore that the data pro- 
cessing and assimilation techniques developed for these sounders during 
the Data System Test may also be used for the future operational 
system. This means that the data assimilation technology developed 
for the present sounders will carry over to the TIROS sounding systems; 
it is hoped that the experimental results reported herein for the 
assimilation methods will then prove themselves operationally. 
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1. Initial-State Differences . Forecasting is an initial-value 
problem. If satellite data are expected to lead to improved forecasts, 
then a necessary condition is that they produce ''ignificant differences 

in the initial description of the atmospheric states. Earlier reports 
by NMC and GISS showed occasional large differences (of up to 60m in 

the SOOmb heights) in data sparse regions. In the impact experiments 
employing the statistical assimilation method, the magnitude of the 
(differences between initial states obtained with satellite data and with- 
out was found to be on the order of 90 to 120 meters in the SOOmb heights 
at mid-latitudes in seven of the eleven initial forecast days during 
the winter test. Such a height difference corresponds rougly to a 
5C mean virtual temperature difference in the 1000 to SOOmb column. 

The differences occurred mainly in data sparse regions and range over 
areas between 10® and 4 x lO^km^. At low latitudes the areas where 
differences are observed were even larger, and so was the magnitude 
of the differences. The initial state differences in the summer were 
smaller, of the order of 30 to 60 meters over regions of areas from 
10^ to 5 X lO^km^. (See difference charts in Chapter S, Figures 16a 
and 16b.) 

The differences produced by the assimilation of satellite sound- 
ing temperatures showed a warm bias in the 1000 to SOOmb thickness over 
the oceans in the mid to high latitudes of the northern hemisphere in 
ten of the eleven winter cases. It is not clear whether this systematic 
bias represents correct observations of a warmer synoptic situation 
or whether it is a spurious feature of the' sounding system. 



2. Effect of Sounding Bate on Analysis. In a report by 
S. Tracton and R. McPherson (SMC office Note 136), it is claimed 
that "the NIMBUS 6 soundings underestimate the variance in the ther- 
mal structure of the atmosphere, and this deficiency acts to the 
detriment of the analyses which ijiaorporate the satellite data." 

This effect has been Investigated in this report in terms of detailed 
subjective and automatic examinations of isentropic cross-sections 
throughout the winter period and also in terms of an analysis of the 
available potential energy budgets for the various experiments, as 
well as fo-r tSMC's own analysis. GISS studies do not seem to sub- 
stantiate the Claim that the sounder data analyses are affected in 
any serious way by a smoothing of the atmosphere's thermal structure. 

Evaluations of isentropic cross-sections in the winter show 
that 406 cases of moderate to intense potential temperature gradients 
{greater than 8 /400km) occurred along longitudes 17fi"w and 150"w 
for the North Pacific. Among these cases, 40 percent were weaker in 
the SAT system while 24 percent were more intense, the remainder being 
about the same. In 119 cases along longitude 85"W over the United 
States, 27 percent were weaker and 8 percent were more intense. This 
indicates that the sounding data are not leading to any systematic 
smoothing of the temperature fields in data sparse regions. Similar case 
results were obtained for cross-sections along specific latitudes in 
the N. Pacific. A tendency toward warmer temperatures was observed in 
the SAT analysis but no systematic smoothing of potential temperature 
gradients was evident. (Examples of isentropic variance are shown in 
Chapter 5, Figures 17 and 18.) 
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In subs6Cti.oii 5.3.3 we show theti the 10~15 percent difference 
in eddy available potential energy between SAT and NO SAT analyses 
is primarily due to the differences in the Aleutian Low. To determine 
which analysis is correct, one would need more complete data in 
order to do a detailed study of the Aleutian areas. On the other 
hand, the GISS and NMC analyses differ by 25 to 50 percent, and they 
over the globe. The NMC analysis scheme seems to con- 
siderably underestimate the available potential energy in the atmosphere. 
This could be a significant source of error in NMC forecasts, if 
underestimation of the variance in the thermal structure of the atmosphere 
indeed has a detrimental effect on the analyses. 

3. Net Statlst-iaal Impact. The average improvement in the 
skill scores of sea-level pressure and 500mb heights for the statisti- 
cal assimilation experiment in the winter test was 5 percent when 
verified over North America and Europe; the corresponding improvement 
in rms error is 10 percent. (See Chapter 3, Tables 41 and 42, re- 
spectively.) This could represent an 8- to 12-hour forecast improve- 
ment. The statistical sigi;!,ificance of these impacts was greater than 
two standard deviations. ){See Cl^pter 3, Tables 40 and 43.) The 
statistical improjyements in the svimmer were 2 percent and 5 percent 
respectively, (see Chapter 3, Tables 35 and 37, respectively) with 
smaller error significance attached to the impact. (See Chapter 3,' 

Tables 36 and 38.) 

The impact of the statistical assimilation method was approxi- 
mately twice that obtained from the use of successive correction . 
methods both in terms of percent impact and statistical significance. 
Compared with a direct insertion method the percent impact was roughly 
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four times as great and even more so in terms of statistical signific- 
ance. (See Chapter 3, Tables 41 through 43.) The improvement in the 
statistical magnitude of forecast impact resolution just from optimal 
statistical weighting of sounding data compared with direct insertion 
is also in qualitative agreement with recent simulation studies reported 
by N. Philips of NMC. Since NMC reports a small but positive impact for 
the winter test roughly comparable to our impact with the successive 
correction method, there is good reason to believe that an adaption of 
the GISS statistical assimilation method will produce a similar improve- 
ment in the forecast accuracy of NMC operational forecasts. 

A substantial positive impact occurred in a number of winter cases: 

3 cases out of 11 showed improvements of more than 20 percent in skill 
score and of 30 percent in rms errors. A longer sequence of impact tests 
is needed, however, to establish whether these cases are random occur- 
rences or whether they are related to weather systems periodically missed 
in data-sparse regions by the current operational systems. 

A further experiment was designed to test the conjecture that 
the impact is not a result of random disturbances produced by the four- 
dimensional temperature assimilation and wind balancing techniques of 
our method but mainly to actual information content extracted from the 
satellite data. In this experiment, simulated satellite data were 
generated at each time step from the 12 hour forecast fields, and tem- 
perature profiles computed at the position of each Nimbus sounding loca- 
tion were introduced; these profiles had the vertical error structure 
of actual satellite data. The errors used to generate the profiles were 
a function of height and latitude; they were obtained from regional 
comparisons with co-located radiosonde profiles. Assimilating these 
"fabricated" data led to negligible statistical impacts in both the sea- 
level and 500mb heights confirming the fact that the sounders provide 
real atmospheric information. (See Chapter 5, Table 4.) 
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4. Subjective Interpretation of Forecast Impact. Verification 
of prognostic charts of the 72-hour forecast errors for the SAT and 
NO SAT system analyzed over North America showed seven examples of 
synoptically better verifications of SOOmb heights for the SAT system 
and two with the NO SAT system. The percent reduction in the forecast 
error in regions where the satellite had an impact ranged from 38 to 
75 percent from day-to-day. Sea-level pressure differences were 
generally not as systematically favorable with the major deficiencies 
occurring over the North Atlantic. These regional impacts lead us 
to conclude that in general satellite data make larger and more con- 
sistent impacts in the SOOmb height forecasts than in surface forecasts 

A computerized local precipitation forecast model was developed 
to test the impact of satellite data in terms of local weather fore- 
casts. The model is based on calculations using quantities produced 
by the numerical model, such as vorticity advection, temperature 
advection; it also makes use of an algorithm embracing conventional 
practices employed for operational precipitation forecasting. The auto 
matic precipitation model was applied to the SAT and NO SAT forecast 
outputs for the eleven cases and precipitation forecasts made for 
the same 128 cities in the United States used by the National Weather 
Service in their monthly regional forecast. The model indicated a net 
15 percent improvement for the SAT system among all the Occurrences of 
different yes/no precipitation forecasts. In particular, when there 
were restrictions on the number of cities to the midwest, in order 
to avoid the effects of mountains and coastal precipitation which 
are more difficult to model, there was a four-fold improvement in 
precipitation forecasting. (See Chapter 5, Table 6.) 
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5. 


Dependence of Impact on Sounder Coverage . Experiments 
were conducted to test the impact of each of the sounders separately 
The statistical impact of temperature data from either the NOAA-4 or 
the NIMBUS- 6 sounder alone was less than the impact when both were 
combined; the magnitudes were in proportion to the respective yields 
of the two sounder systems separately, and of the combined system. 

This result supports earlier simulation studies reported by GISS 
where it was shown that (i) two satellites damp down wind errors 
more effectively than one, and (ii) that two satellites with ob- 
servational errors of approximately 2®C have a comparable effect to 
one satellite with 1°C observational error. 
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CONCLUSIONS 


GISS impact test results point to two major areas which, if 
improved, can bring about larger forecast impacts from satellite 
sounder systems . 

First, technology must be developed to improve the accuracy 
and vertical resolution of the sounder temperature profiles themselves. 
At present, the accuracy of vertical temperature sounding profiles 
derived from satellite radiance data when compared with co-located 
radiosonde profiles have rms errors of approximately 2-2. 5°C. Although 
theses accuracies fall short of meeting GARP data requirements, the data 
are still capable of producing the modest impacts demonstrated in this 
report when properly utilized. However, the deficiencies in the quality 
of the data can only partially be compensated for by special processing 
and assimilation methods. While continuous data monitoring and close 
interaction between the processing of raw data and the assimilation 
of processed data will remain as major considerations, the need for 
more accurate temperature profiles under all conditions is still the 
most important requirement. 

Second, numerical prediction models themselves must be improved 
to make better use of the sounding data. In order to successfully 
assimilate synoptic data and have them contribute to more accurate 
forecasts, it is necessary that the model be able to convey information 
accurately over extended distances and periods of time from one region 
of the globe to another. Improvements in model forecasts can only 
proceed by a judicious combination of higher grid resolutions, more 
accurate numerical discretization methods, and better representations 
of atmospheric processes in the model. 


A concerted effort in designing better observing instruments 
and systems, refining the methods for processing and assimilating 
their observations, and developing better numerical models will 
lead to considerable improvements in numerical weather prediction 
and to a better understanding of the atmospheric circulation; 
these are the goals of the Global Atmospheric Research Program, 
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CHAPTER I 



1. INTRODUCTION 


1.1 BACKGROUND 

Complete atmospheric temperature profiles with global coverage 
have been available from spaceborne IR grating spectrometers since 
SIRS 1 flew on NIMBUS-3 in 1969. Since that time, NASA and NOAA 
supported the evolution and flight testing of a series of instruments, 
each possessing significantly improved technological capabilities 
with respect to horizontal spatial resolution, spectral resolution, 
and scanning coverage. This effort led to the introduction of the 
VTPR instrument in December 1972, as the first operational sounder 
to become part of the data base of the National Weather Service. 

These operational sounders have been producing roughly 1000 VTPR 
sounding temperature profiles per day for use by NMC; this number is 
equivalent to half the total nvimber of radiosonde reports, and they 
are routinely incorporated into the operational analysis. 

More recently, prototypes of advanced sounders, which are 
expected to replace the current operational VTPR instrument, were 
flown and tested on NIMBUS— 6. In spite of further technological 
improvements in sounders, the accuracies of temperature profiles have 
improved only marginally while the yield has been greatly increased. 
This quality of information has led to downward revisions for the 
expected accuracy of the TIROS sounders and in turn has led to a grow- 
ing concern in the meteorological community about the effectiveness 
and usefulness of the sounder capability for the First GARP Global 
Experiment (FGGE) . 

During this period NOAA and NASA have conducted a limited number 
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of experiments on the operational impact of sounding data. Studies 
conducted at NMC with temperature data from the original SIRS and 
VTPR instruments and, more recently, from the new NIMBUS instruments, 
find no impact of satellite sounding data on forecast accuracy. Some 
scientists at NMC suggest that sounding data will actually degrade 
the forecast skill when numerical models with higher resolution are 
introduced into operational forecasting. 

These findings run counter to conclusions reached from similar 
sounder studies conducted earlier at GISS. The studies reported by 
GISS find small but favorable forecast impacts in 48 to 72 hours 
when the full yeild of satellite data is inserted into the analysis. 

This concern with sounder performance evidenced itself at a 
GISS program review held in March 1976, where a steering committee 
composed of scientific consultants and NASA management personnel 
recommended that program priority be given to tests of forecast 
impact from the NIMBUS-6 sounding data. 

In accordance with this recommendation, a DST Sounding 
Temperature Impact Test Project was set up at GISS and a work plan 
submitted on April 15 was approved. That plan specified a definite 
assessment by December 31, 1976, and a preliminary assessment was 
delivered to the NASA administrator on December 6, 1976. This 
report serves to document that assessment and presents more recent 
results and investigations bearing on the interpretation of the 
sounding impacts. 
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1.2 ASSESSMENT OF FACTORS INFLUENCING THE SOUNDER IMPACT ON FORECASTING 


Aai,uracy. The most important factor in forecast impact 
would seem to be the accuracy of the sounding data. Simulation 
studies confirm that data accuracy is in fact a significant element 
in forecast impact. RMS errors for sounding temperatures as com- 
pared with co-located radiosondes are about 2.5”c well above the 
desired accuracy levels specified in GARP documents. However, the 
yield of data, i.e., the amount of sounding data available as input 
for data assimilation, has turned out to be of comparable Importance 
both in the simulation study and in the real data tests. The 

importance of yield relative to accuracy was one of the surprises 
in this series of tests. 


field and Coverage. The importance of yield in terms of 
forecast impact was a major consideration in the design of the GISS 
assimilation method. In simulation studies and in later real VTPR 
data tests, studies consistently showed that the magnitude of the 
impact was proportional to the guantity (frequency of Insertion per 
gridpolnt per day, of data inserted in the model. Por example, 
results Of the simulation study shown in Figure 1 indicate that 
sounding temperature profiles from two satellites having 2.5»c error 
accuracies yield initial states of comparable accuracy that would be 
provided from one satellite sounder having 1 - accuracy. 

The trade-off between accuracy and yield has never been fully 
exploited by the operational groups responsible for providing tempera- 
ture sounding data, nor by the groups responsible for Incorporating 
the sounding profiles into operational forecast systems. Part of the 
reason this idea apparently failed to take hold in operational 
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RMS ZONAL WIND ERRORS (M/S) 



28 



practice was the fact that processing procedures were developed 


to toss out data which were perceived to be suspect by cloud 

)/ 

contamiliation thereby reducing the yield. Alternative techniques 
were proposed by GISS which could have greatly increased the yield 
without degrading the overall accuracies. Similarly, techniques 
utilizing the full field of observations, based on four-dimensional 
assimilation and horizontal temperature gradients corrections that 
could be used to adjust the mass field, were also tested and 
recommended . 

The NIMBUS- 6 sounding data and the processing techniques 
developed by W. Smith et al. , for the DST-6 data, led to a different 
situation. The HIRS and $C.^S sounder systems provided roughly 5000 
soundings per day with overall accuracies comparable to the VTPR. More- 
over, the information in these data is much less correlated with the 
first guess fields supplied than the current VTPR operational systems, 
which use the NMC forecast as the first guess. There does not 
seem to be in the NIMBUS system, any consistent bias or significant 
reduction of yield in the presence of clouds. 

Although the GISS studies analyzing the effect of clouds on 
the accuracies of the temperature profiles aria incomplete, no 
evidence of a cold bias in cloudy regions was detected. To the 
contrary, there may be a compensating bias everywhere on the warm 
side to account for clouds. Confidence in the quality of these 
data is enhanced by similar findings obtained with our own processing 
techniques developed for these data. The GISS methods for the 
HIRS/SCAMS sounders are radically different from those of NESS, yet, 
the comparisons of temperature data quality seem to give consistent 
results as is shown in Chapter 2. As a result of the increased yield, 
the impact studies produced substantial differences in the initial 


1-5 


states and those differences led to a beneficial average forecast 
impact for the system with satellite data. 

A recent point raised by analysts at NMC concerns the ability 
of sounding data to specify the thermal structure of the atmosphere. 
Isentropic cross-section analyses performed on these data by NMC 
reveal significant reductions in the variance of the fields due to 
a smoothing of the temperature gradients as compared with the 
structure shown in the radiosonde analysis. The GISS investigation 
of this problem, as shown ii^ Chapter 5 shows no systematic smoothing 
of potential temperature gradients in data-sparse regions. 

Data Assimilation. The design and development of proper satellite 
data assimilation techniques is a major aspect of the total analysis 
system. The reason special efforts are required in this area is the 
enormous volume of satellite data that is available and the large 
errors in these data, which have to be assimilated along with conven- 
tional in situ observations. If one applied the conventional technique 
of intermittant synoptic insertion of all the data, then most of the 
information content of the asynoptic data will be lost as a result of 
time-space averaging. Automatic quality control checks are desirable 
but difficult to apply in data-sparse regions. As a result of ex- 
perience gained over many years of experimenting with satellite data 
assimilation methods, a scheme was developed based on theoretical 
findings and practical results reported in the recent meteorological 
literature. The method implemented a time-continuous, four-dimensional 
assimilation procedure based on statistical weighting of temperatures 
and on geostrophic wind corrections; it modified the technique so as 
to deal with the practical problems imposed by the available real data. 
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Of all the components used in. the assimilation scheme, the impact 
resulting from statistical weighting procedures may be the most 
significant. Serious mathematical and computational problems 

^v^ssociated with this method were encountered and considerable care 

.. \ 

w,\nt into the solution of these problems. The methods are described 
in some detail in Chapter 3 of this report and also appear in the 
earlier Phase I Study Report. 

The main point to be commented on here is that the GISS technique 
is adaptable and transferable to an operational forecast system. If 
this scheme or reasonable facsimile thereof were introduced into an 
operational practice, then significantly improved initial state deter- 
minations and forecast accuracies could result by 1978 when applied to 
the TIROS, -N sounding data. 

Forecast Model. The magnitude of forecast impact is highly 
dependent on the skill of the forecast model. Clearly, if the forecast 
model breaks down well before 48 to 72 hours, no matter how well the 

data in the northern hemispheric oceans is specified, the impact will 
be negligible. Predictability studies show that today's forecast 
models will have* a (significant downstream response to finite amplitude 
differences in the initial states over the oceans in 48 to 72 hours, 
when the differences in the initial states are as large as those pro- 
duced by the satellite data. The major concern is to what extent can 
the improvement in skill of the large scale synoptic forecast at 72 
hours be useful to local weather forecast operations. To the extent 

that the numerical weather forecasts are improved on these time scales 
by better models, the impact of satellite data is expected to be 
additive to that of model improvement. 
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NMC is currently engaged in an intensive effort to develop a 
high resolution model. Results with a limited-area forecast model 
for the past year show skill score improvements in sea-level pressure 
and 500mb heights on the order of 5 to 10 percent. This translates 
into a 12-hour forecast gain in the accuracy of large-scale synoptic 
predictions. The GISS studies with a higher resolution model show 
similar forecast improvements (Chapter 4) . 

Forecast improvements of these magnitudes using NIMBUS-6 and 
NOAA-4 sounding data were obtained without any increase in the model 
resolution (Chapter 5). Tracton and McPherson (1977) speculate that 
the performance of high resolution models will be degraded by satellite 
data. In the few limited forecasts made with a higher resolution GISS 
model results do not substantiate these speculations. In fact, to 
the contrary, the GISS high resolution model (250km mesh size) produced 
somewhat more substantial impacts in the forecast skill than the 
low resolution model as a result of using satellite data. Results? 
seem to suggest that the combined effects of resolution and tempera- 
ture sounding data may be additive. If this is confirmed by further 
tests, it could produce a major increase in the skill of operational 
72-hour forecasts. 

1.3 OPERATING APPROACH 

It was recognized from the outset of this project that the 
success of the program ultimately rests on the quality of the data 
and the forecast skill of the model. The winter DST data sets 
offered the best chances of showing an impact because of the active 
systems originally in data sparse regions and moving over land in 
48 to 72 hours. Although the satellite-borne instruments were 
seriously degraded during the winter period, losing all 15um 
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channel capability the sounding data were reprocessed by NESS so as 
to include special efforts to filter the instrument noise. As a 
back-up system in case the NESS procedures were not effective, GISS 
developed its own temperature retrieval techniques. As a result of 
the quality of the sounding data, additional quality controls to 
check the data were added to the GISS data assimilation schemes. 
Furthermore, because the volume of data was so large, balancing 
techniques were developed and tested in order to minimize the shock 
effects produced by data insertion. In addition, it was desirable 
to use an improved forecasting model, if possible, which might be 
more responsive to differences in the initial states. 

An important constraint imposed on the project was to demonstrate 
in operational terms the impact of sounding data on forecast operations 
This meant the development of product outputs and verification tech- 
niques that are standard practice at NMG. 

The project has been organized into the following four activities 
The general approach to meeting these program objectives is described 
below and the specific programs to develop and demonstrate sounding 
capabilities are detailed in the subsequent chapters. A brief 
description of the specific program objectives of the four groups are: 

# Sounder Temperature Studies: This group had two tasks. 

Firsts to assess the quality of the IR and microwave data with 
respect to their dependence on initial guess, clouds and atmospheric 
effects, such as sea-level albedo and other uncertainties in the 
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calculations of transmission functions; and second, to develop an 
alternative to the NESS retrieval prd'cessing system for the HIRS and 
SCAMS sounders based on Chahine's duail frequency principle. 

Jl ir 

a 

• Assimilation and Analysis: This group was responsible 

for developing an analysis scheme and new assimilation techniques 
which would make use of the error structure of the satellite 
data in blending them with conventional data. It also iRas to 
develop filtered models which minimize the shocks of imbalanced 
sounding data. 

• Forecast Model Development; To develop a higher reso- 
lution (vertical and horizontal) numerical forecast model in 
order to improve the accuracy of forecasts up to four days. 

• Evaluation and Verification Test: To evaluate the 

impact of satellite data on medium-range forecasts in the context 
of a real-time forecast operation. Emphasis in evaluation tests 
was on practical utility, i.e., usefulness to a local forecaster 
in the field. 

In each area listed above the report will show the development 
of a significant technological capability which we believe will 
lead to a further improvement in the forecast impact in the future 
tests with FGGE data sets. 
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CHAPTER II 




2. SOUNDING TEMPERATURE STUDIES (STS) 

(J. Susskind, Scientist; D. Edelmann, Manager) 


2.1 INTRODUCTION 


The DST operational data set of temperature profiles derived 

from satellite borne observing systems ,VTPR on NOAA 4 and HIRS 

and SCAMS on MIMBUS 6) was produced at MOWNESS. Most of the 

rmpact studies discussed in the remaining sections of this report 

use the operational temperatures of these as their data base. The 
9.CCU3T3ci0S 9.nd o-F 

these operational temperatures are pre- 
sented in Section 2.2 of this Chapter. 

The remainder of this chapter of the report discusses the 
theory of temperature sounding, presents an alternate method de- 
veloped at GISS, for deriving temperature profiles from sounder data 
and finally gives the results of a number of studies for measuring 
and assessing the quality of the retrieved temperature profiles. 

The quality of temperatures retri 

rures retrieved using the methods of GISS and 

NESS are compared and shown to be frenor-=n 

5 ally comparable to each other. 

The theoretical section of this report deals primarily with 
he two main problems facing temperature sounding from satellites, 
the effects of clouds on the radiances, and limited inherent ver- 
al resolution, even when the clear column radiances are known 
These pr blems are amplified by noise of an instrumental nature, 

LZTJ" ^ computational 

. ecting the ability to accurately reproduce the physics 
giving rise to the measurements as a function of temperature. 
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The limited vertical resolution of the measurements is a 
result of the fact that the photons entering into the observed 
signal arise from a wide portion of the atmosphere. Figures 1 
to 4 show the weighting function and Planck-weighted weighting 
functions for the temperature sounding channels on the VTPR, 

SCAMS, and HIRS sounders used ‘in the DST experiment. The latter 
curves indicate the portion of the total signal arising per unit 
height from each pressure. The broader the curve, the less spe- 
cific the measurement. The peaks of the weighting functions and 
Planck-weighted weighting functions for the channels are summarized 
in Table 1. The resolution cannot be higher than the spacing be- 
tween adjacent peaks. 

There has been much discussion of the relative merit of micro- 
wave and infrared sounders . Microwave sounders such as SCAMS have 
the advantage that, given a temperature profile, their observations 
are essentially unaffected by clouds in the field of view. As 
seen from Figure 4 and Table 1, SCAMIS is characterized by limited 
vertical resolution, having only two sounding channels in the trop- 
osphere. Microwave sounders also hcive a potentially large source 
of computational noise due to a low and variable surface emissivity, 
which must be determined accurately before meaningful microwave 
sounding can be made. 

Infrared sounders, such as VTPR and HIRS, have the potential 
of achieving higher vertical resolution and are less affected by 
variations in surface properties. The presence of clouds in the 
sounder's field of view has a major effect on observed infrared 
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Table 1. Peaks of Weighting Function in- Mb 


CHANNEL 


FREQUENCY (CM ) 


WT. PEAK 


B WT. PEAK 


HIRS- 

SCAMS 

669.0 

30 

679.0 

60 

690.0 

100 

700.0 

280 

716.5 

475 

732.0 

725 

749.5 

surface 

2190.0 

surface 

2210.5 

650 

2243.5 

340 

2271.5 

170 

2357.0 

15 

22.235 GHZ 

window 

31.400 GHZ 

window 

52.850 GHZ 

surface 

53.850 GHZ 

500 

55.450 GHZ 

200 




VTPR 


668.0 

679.8 

696.9 
707.2 
725.1 

748.9 


30 

60 

140 

400 

725 

surface 


3 

60 

140 

475 

900 

siirface 








8 

O 


Figure 1. Unweighted and Planck -Weigh ted Weighting 
Functions for VTPR Temperature Sounding 
Channels. Dry Standard Atmospjiere. Nadir 
Viewing. 
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Planck-Weighted Weighting Functions 
Channels. Dry Standard Atmosphere. 
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Figure 3. Unweighted and Planck-Weighted Weighting Functions 
for HIRS 4.3ym Channels. Dry Standard Atmosphere. 
Nadir Viewing. 
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radiances, however, and this factor must be dealt with accurately 
before meaningful infrared soundings can be achieved. 

This study has also addressed the ability of the VTPR tem- 
perature sounder on NOAA 4 along with the combined HIRS-SCAMS 
temperature sounder on NIMBUS 6 to deal with the problems of 
clouds, vertical resolution, and the accuracy of temperature re- 
trievals for each instrument. Our conclusions show that effective 
cloud filtering (i.e., determination of clear column radiances) can 
be obtained by use of combined HIRS-SCAMS observations or by use of 
either instrument separately. The VTPR instrument, however, has no 

I 

cloud filtering ability of its own and hence cannot give informa- 
tion about surface or lower tropospheric temperatures independent 
of outside information. Both sounder systems have only moderate 
vertical resolution below 400 mb and contain very little informa- 
tion at the levels of 300, 250, and 200 mb. 

The HIRS and SCAMS sounders give comparable quality retrievals 
when used separately indicating, on the one hand, that clouds are 
not seriously degrading the quality of infrared retrievals, and, on 
the other hand, that HIRS is not realizing the potential for signif- 
icant improvement in results when the full complement of HIRS chan- 
nels can be used. During the winter DST periods, when the 15-ym 
channels on HIRS malfunctioned, HIRS alone retrievals were irfpossible 
and combined HIRS-SCAMS retrievals were only marginally better than 
SCAMS alone. 
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2.2 OPERATIONAL TEMPERATURE RETRIEVALS FOR DST-5 AND DST-6 

2.2.1 NIMBUS-5 KIRS. SCAMS, THIR 

2.2. 1.1 Overview 

In August 1975, and again in January 1976, GISS initiated 
real-time processing operations of NIMBUS 6 sounding data for the 
GARP Data Systems Tests (DST) -5 and -6, respectively. The raw 
sounding data were processed into calibrated. Earth— located 
radiances and then into temperature and humidity profiles by a 
technique developed by NESS/NOAA (Smitli,'^ Hayden, Woolf, et al.) 
and integrated into a DST-supportable system by GSFC personnel 

■ A- 

(Gary, lobst, et al.) 

Although plans called for a SO-day DST-5 data set of amalga- 
mated temperature and humidity profiles from the HIRS, SCAMS, and 
THIR sounders, and a 65-day data set of equivalent DST-6 profiles, 
neither test generated a full data base. 

Processing operations for the summer test were discontinued 
on September 5, when excessive noise was detected in the 15 ym long- 
wave channels. This condition, which persisted through €he DST-6 
period, required major changes in the temperature extraction tech- 
nique to compensate for the loss cf these channels. 

The start of DST-6 was delayed until late January when a 
malfunction in either the HIRS instrument or in the data recording 
device on board NIMBUS 6 caused a bit slippage in the structure of 
the raw data. This problem was overcome by changes to the INGEST 
section of the software and- real-time processing operations com- 
menced on January 23. y 
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Subsequent analysis of the processed microwave sounding 
data by NOAA programmers, revealed that the algorithm which co- 
locates microwave with infrared soundings, contained an error in 
the scanning direction of the microwave instrument. A management 
decision by the GARP Project Office was made in April 1976, to 
reprocess both DST data sets from the raw data archived in the 
tape library at GISS. These activities came to a successful com- 
pletion in March 1977. 

2. 2. 1.2 Data Systems Test-5 

Data Systems Test-5 was planned to start in mid-August and 
run for 60-days' duration. However, due to the difficulties in 
the 15y channels, which forced the prematuie termination of the 
test, the final data set only contains profiles from 21Z August 
17, to 12Z September 4 for a total of 17.6 days. 

2. 2. 1.2.1 Yield 

Table 2 and its graphic equivalent in Figures 5 and 6 , show 
the daily composition of the data in terms of time gaps and profile 
counts . 

With the exception of August 21, 22, 25, 30, and September 2, 
for which at most one orbit of data is missing, the remaining days 
Contain rather large data gaps with the worst cases occurring from 
August 26 through August 29. These are large discontinuities, 
especially when compared agianst similar DST-6 statistics, which 
account for almost 23 percent of the total data set and which are 
reflected in the large daily fluctuations in the number of retrieved 
For those days for which the data are most complete. 
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Table 2. Missing Data and Profile Count for DST-5 NIMBUS 


(Hours) 


18 

19 

20 

21 

22 

23 

August 
24 25 26 

27 

28 

29 

30 

31 

September 
1 2 3 4^ 

Totals 

6.4 

9.7 

7.4 

1.8 

1.7 

5.3 

4.3 1.8 10.9 

7.4 

8.4 

9,9 

0.4 

7.5 

6.9 1.9 3.2 1.9 

96.8 

4163 

4546 

3693 

5842 

6055 

5178 

5083 5912 4353 

3311 

3923 

3867 

5100 

4859 

3996 5623 4745 3994 

84,243 


Data available to 12 GMT only. 


Table 3. Missing Data and Profile Count for DST-6 NIMBUS 


February 


2 3 4 5 6 


8 9 


Missing Data 0 3.7 0.9 0.5 1.5 3.6 2.3 3.7 1.2 0.9 0 0.6 2.2 0 0 5.0 0 3.8 0 4.0 1.9 0 

(Hours) 


Profile Count 5755 5220 5501 5525 5872 5146 4797 5581 5265 6020 6091 6110 5518 5108 5929 4813 5551 4638 5923 5103 4728 6334 


Date 

23 

24 

25 

26 

27 

28 

29 

1 

March 
2 3 

4 

Totals 

Missing Data 
(Hours) 

0 

2.6 

5.6 

0.3 

2.1 

4.4 

0 

1.9 

1.8 0 

0 

54.5 

Profile Count 

6361 

5716 

4845 

6177 

5674 

4602 

5943 

5819 

5755 5955 

6159 

183,534 


























the average global profile count of approximately 5700 retrievals 

/i 

compares closely with the average number of profiles obtained 
during DST-6 . 

2. 2, 1.2, 2 Accuracy 

Figure 7 shows the weekly RMS errors of profiles retrieved 
over water and colocated to within +110 km and +3 hours of radio- 
sonde observations. The overall accuracy for the entire period 
is of the order of 2.29°, and as can be seen from the Figure, only 
withiri the tropopause region (250 mb to 100 mb) do the errors in- 
crease to 3®. 

It must be noted that these errors (and those given in Figure 
8 for DST-6) were computed by restricting the observations in the 
sample to those profiles that do not exceed 5® errors for the 
column and 7® errors for the individual levels. 

2. 2. 1.3 Data Systems Test-6 

Data Systems Test-6 was planned to start on January 1 and 
run for 65-days' duration. Problems with bit slippage and the con- 
sequent modifications made to the software, delayed the start of 
^®^l“time operations to January 23; final reprocessing, subsequent 
to software corrections for the microwave scanning direction error, 
was also started from this date. 

The final archived data set does not contain profiles before 
February 1, because a one week start-up period is required to 
generate accurate multi-level and surface analysis fields 
for fine tuning the retrieved temperatures. 
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2.2. 1.3.1 Yield 


Table 3 and its graphic equivalent in Figures 5 and 6, shows, 
in contrast to DST-5, that the data for this period is extremely 
continuous in its coverage. There are 21 days for whic/h at most 
one orbit of data is missing, and for these the global average is 
5800 retrievals per day. 

The continuity of this dataset is the result of a coordinated 
effort between GISS and MHDS (the NIMBUS 6 archives at GSFC) to 
recover and process every available orbit. Similar efforts for 
DST-5, were not as successful due to problems in the date-time 
identification of the HIRS and SCAMS orbits. The subsatellite 
tracks of the missing orbits, the actual time and date of the data 
gaps, and the complete count of profiles for DST-6, are presented 
in Appendix A. 

2. 2. 1.3. 2 Accuracy 

The weekly DST-6 accuracies, shown in Figure 8, indicate 
that these temperatures are of poorer quality, in an RMS sense, 
than those for DST-5, by approximately 0.7°. 

This reflects the fact that for the latter period all instru- 
ments were functioning properly, while the former operated with 
the 4.3p and microwave channels only. 


2-17 




2.2.2 NOAA-^ VTPR 
2.2.2. 1 Overview 


The VTPR instrument, which became operational in December 
1972, has been returning usable global temperature and humidity 
soundings taken from on-board the NOAA 2,3 and 4 satellites. 

The Level I radiances, the first guess temperature values used 
in the NESS technique, and the NESS operational retrieved pro- 
files, have been routinely archived at GISS during the operational 
life of the instrument and used in the 4-dimensional GIss assim- 
ilation scheme directly as an operational product, and as GISS- 
derived temperature profiles. 

TllXS SGC'tXOn ITGVXGWS th© t - l-xr 

vxews tne qualxty and coverage of the operational 
NESS temperatures, for the DST-5 and DST-6 test periods. 


242,2.2 DST-5 and DST-6 Yields 


Tables 4 and 5 and their graphic equivalent in Figures 9 

and IQ show the daily composition of ' the data in terms of time gaps 
and profile counts. 

As can be seen from Table 4, the data coverage for DST-5 
«ith the exception of August 28 «hen 50% of the orbits are missing, 

. is fairly continuous. For the 18-day period the number of retrievals, 

which are obtained only over water nri-in4-r. 

y over water points, average to a little over 

1000 profiles per day. 

Table 5 for DST-6 on the other hand, shows the data coverage 
to be much less continuous after February 21 than during the first 
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Table 4. Missing Data and Profile Count for DST-5 VTPR 


August September 

18 19 20 21 22 23 24 25 26 27 28 29 30 31 1 2 3 4 


Totals 


Missing Data 1.8 2.5 4.7 2.8 3.4 2.6 1.2 6.5 2.0 2.1 12.0 3.9 1.9 4.6 1.8 1.8 4.6 7.5 67.7 

(Hours) 

Profile Count 1106 1104 1003 1144 1024 1116 1125 1017 1146 1132 715 1034 1064 997 1136 1144 1047 890 18,944 


Table 5. Missing Data and Profile Cotint for DST-6 VTPR 



(Hours) 


1 

2 

3 

4 

5 6 

7 

8 

9 

February 
10 11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

3.3 

6.6 

5.5 

B 


3.4 

2.1 

7.6 

4l3 3.2 

6.5 

6.2 

11.3 

6.2 

1.5 

3.2 

3.3 

2.9 

5.9 

15.3 

9.2 

1258 

1087 

1097 

1181 

863 1250 

1241 

1231 

1024 

1134 1272 

1073 

1059 

785 

1073 

12.41 

1253 

1279 

1237 

1114 

498 

902 



Missing Data 
(Hours) 


Profile Count 










March 


23 

24 

25 

26 

27 

28 

29 

1 

2 3 4 

Totals 

16.5 

20.4 

11.9 

13.5 

8.7 

13.6 

14.3 

16.8 

11.8 6.6 15.6 

284.7 

632 

217 

708 

620 

917 

623 

506 

438 

695 958 453 

30,413 
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Figure 9. Missing Data from DST-5 and DST-6 VTPR Temperature Data Sets 
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Figure 10. Daily Yield of VTPR 






the result of problems 


part of the test period. These time gaps are 
enccuntared during the transmission of the data from NESS to GISS, 
and the almost complete breakdown in data link communications towards 
the end of the experiment, although from February 1-20 the average 
number of retrievals is over 1100 profiles per day, the yield is 
reduced to an average of only 620 dally profiles for the latter 

part of the test. 

2. 2. 2. 3 DST-5 and DST-6 Accuracies 

Figure 11 and Figure 12 show the weekly RMS errors of pro- 
files retrieved over water and colocated to within +3 hours and 
+110 km of radiosonde observations. Also shown are the RMS errors 
of the initial guess used in these retrievals. The same error cut- 
off criteria applied to the NIMBUS accuracies (Sections 2. 2. 1.2. 2 
and 2 . 2. 1.3. 2) have been used here to evaluate the VTPR retrievals. 

Both periods show good accuracies, with DST-6 errors roughly 
0.10» worse than in the summer. The Initial guesses, coming from 
a 12-hour forecast, are also very good in the regions near radio- 
sondes. The accuracies of retrievals in data poor regions, where 
the forecast guess is of poorer quality, is of unknown quality. 

2.3 GISS APPROACH TO TEMPERATURE SOUNDING: THEORETICAL CONSIDERATIONS 

The basic theory for temperature retrievals and the techniques 
developed at GISS for their Implementation are discussed in detail by 

Susskind et al. (1977). The theory discussed in this report will 

deal primarily with special considerations for the HIRS and SCAMS 
sounders . 
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2.3.1 Temperature Retrievals Given Clear Column Radiances 

There are many techniques for retrieving atmosphere tempera- 
ture profiles from radiance observation. The approach used by NESS 
in creating the operational DST temperature profiles involves the 
use of statistics, i.e., tabulation of past radiance observations 
together with colocated radiosonde temperature measurements . The 
approach used at GISS is based on the method developed by Chahine 
(1972, 1974, 1975), and does not rely on past statistics. Avoiding 
the use of statistics gives one a greater chance of finding unusual 
meteorologically significant temperature profiles, such as those 
indicating passing fronts, which would have a great impact on a 
forecast. It also places a greater emphasis on being able to the- 
oretically reproduce the atmospheric physics giving rise to the 
measurements . 

The approach involves taking an initial guess temperature 
profile, calculating clear column radiances, comparing with the 
observations, and modifying the guess profile iteratively until 
agreement is reached. 

For each sounding channel used, the guess is modified ac- 
cording to the equation 

Ri,clr 

B . (Pi) ] = Bi (Pi) ] ; (1) 

^ Ri(n) 

where Bi [T] is the Planck black body function evaluated at sounding 
frequency i and temperature T; Pi is a characteristic pressure for 
channel i, typically the peak of the weighting function for that 
channel; T*^(Pi) is the n^^ guess temperature at Pi; Ri" is the clear 
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column radiance calculated for channel i using T^(P); and Ri,clr 
the "observed clear column radiance," i.e., the radiance which would 
have been observed if the field of view of the observation were 
completely clear. In fact, the field of view is in general at 
least partially cloud covered, and the "observed clear column radi- 
ance" is in fact not an observation but must be constructed from 
the observation by filtering out the cloud effects. Two techniques 
for doing this are described in the following section. One uses 
only infrared observations and the other uses combined infrared 
and, microwave soundings . 

2 . 3.2 Cloud Effects 


consider a field of view which is otherwise homogeneous but 
partially cloud covered with cloud fraction ct. The radiance ob- 
served by a sounding channel i can be written as 


Ri = (l-a)Ri,clr + “Ri,cld 


( 2 ) 


where Ri,clr is the radiance which would have been observed if the 
entire field of view were clear, and Rf^cld radiance if the 

entire field of view were cloudy. The clear column radiance can 
be written (neglecting solar radiation) as 


Rh 


[£iBi(Tg) + (l-ei)Ri'M li(Ps) 


InPg 

+ f Bi[T(P)] 
InP 


dxi 

dInP 


dlnP 


(3) 


where ei is the surface emissivity; B^CT) is the Planck black body 
function evaluated at sounding frequency and temperature T; 
is an effective downward flux of thermal radiation? x^CP) is the 
channel-averaged transmittance from pressure P to the top of the 
atmosphere; and P is a pressure above which there is little atmos- 
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if 

/ 

/ 


pheric absorption. The term is called the weighting function 

for chaiihel i (see Figures 1 to 4) and is a measure of the extent 
that the temperature at a particular pressure level contributes 
to the integral in Equation (3), and hence to the signal in channel 

i . 

Ri^cld written as 

A 

Ri,cld = ■^i,c^i,clr + ^^i,c®i('^c) + ni,cRi,c'H "^i (Pc) + 


XOP Q 'r 

U-n.o) /- Bi [T(P)1 dlnp , 

InP^ 


(4) 


where ^ is the transmissivity of the cloud at ei,c 

emissivity, ni,c reflectivity, Ri,c'^ effective downward 

flux striking the cloud, is the cloud top pressure, and is the 
cloud temperature. If ti^c ~ microwave region, the 

cloud radiance becomes equal to the clear column radiance (because 
n- +£. ^ + ,, = 1) and Equation 2 becomes independent of 

cloud fraction a. For microwave channels, the temperature profile 
then can be constructed directly with no cloud filtering, as 
described previously, provxded Sj_ is known or can be determined. 


23.2.1 Cloud Filtering 

In the infrared, however, Xi c ~ must be able to 

either calculate Rf^cld directly or to otherwise determine clear 
column radiances from the observations. Ri,c calculated 

assuming Ei,c» ni,c» ^c' ^nd Tc are known. In the 15-vim region, 

^ ~ 1 for most clouds so Rf^dd can be evaluated as a function 
of Pc (and Tc> . Cloud properties are more variable in the 4.3-vinv 
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region and evaluation of Rj^ becomes more difficult. Evalua- 
tion of Ri^cld unnecessary, however, if measurements are made 
in dual fields of view. 

2. 3. 2. 1.1 Dual Field of View Approach 

If measurements are taken in two adjacent, otherwise homo- 
geneous fields of view but with different cloud fractions ax and 
a 2 then it follows from Equation (2) that 

%,clr " ^i,l ’^(^i,l " ^i,2> (5) 

where Ri,j is the observation in channel i in field of view j and 

ax 

“ a2-ax (6) 


Since n depends only on the ratio of the physical cloud cover in 
each field of view, it is channel (and spectral region) independent. 
Determination of n is equivalent to determination of the clear col- 
umn radiances for all channels through Equation 5 without having 
to make any assumption of the cloud properties. In the above, 
field of view 1 is always taken as the clearer (warmer) field of 
view and n should be a positive quantity. 

2. 3. 2, 1.2 Determination of n - Infrared Channels 


If the clear column radiance is known for channel i, n can 
be calculated according to 


Hi = 


%,clr ^i,l 
^i,l " ^i,2 


(7) 


In general, known but can be approximated from the 

nth guess temperature profile and n determined according to 


hi 


(n) 


- R 

^,clr ^i,l 
R. , - R. o 

X f 1 X / 2 


( 8 ) 


( n ) 

where calculated from Equation (3). Neglecting instru- 
mental noise on R. , and R. ^ and computational noise on , 

(n) i,clr' 

will be incorrect only insofar as the iterative temperature 
profile is incorrect. The sensitivity of n to temperature errors 
can best be assessed by considering apparent temperature profiles. 


2 , 3 , 2 . 1.3 Apparent Temperature Profiles 


Chahine (1975) has shown that if one treats cloud contaminated 
radiances as clear column radiances and retrieves an "apparent tem- 
perature profile," then the true temperature profile is related to 
the apparent temperature profiles in the two fields of view according 
to 


B^[T(P)] = B^[T^(P^)] + n{B^[T^(P^)] - BitT2(P^)]} (9) 

where P^ is the pressure corresponding to the peak of the weighting 
function for channel i, Tj^(P) is the apparent temperature profile 
in field of view 1, T 2 (P) is the apparent temperature profile in 
field of view 2, and T(P) is the true temperature profile. 

If the true temperature T is known (or guessed) at a charac- 
teristic pressure P^ , then r) ^ can be calculated according to 

B. [T(P )] - B [T (P.)] 

n . = J 3 ± 1 . (10) 

^ B [T (P )] - B. [T (P.)] 
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and a subsequent temperature profile, (P^) is obtained by sub- 
stituting rij into Equation (9). For best cloud filtering one 
must find the appropriate channels j and {i} such that errors in 
the initial guess T(Pj) produce the smallest errors in the retrieved 
temperatures (P^) . Note, for example, that if channel j, used 
to determine n , is also one of the channels {i} used to determine 
apparent temperature profiles, it follows from Equations (9) and 

(10) that T. (P.) = T(P.), i.e., the retrieved temperature at P . is 
D D D D 

equal to the guessed value at that level, giving maximum sensitivity 
to initial guess errors. 


2 . 3 . 2 . 1.4 Sensitivity of n to Initial Guess 


The error in rij/ as calculated from Equation (10), caused by 
an error in the guessed temperature, T(P^) , can be approximated as 


3B.(T) 

An. = — AT(P.) = — 3 

3 9T 3T 


AT(Pj) 


Bj[Ti(Pj)] - Bj[T2(Pj)] 


( 11 ) 


Approximating the Planck black body function in the infrared as 


B. (T) = a 
1 3 


( 12 ) 


and expressing the apparent temperature in field of view i at 
pressure P^ as obeying the relationship (Chahine 1975) 

B.[T (P )] = (l-a.)B [T(P )] + a.B (T ) ; (13) 

J-^J J IjC 

where T(P.) is the actual temperature at P . , and T is an effective 
J D c 

cloud temperature, one obtains 


Bj[T(Pj) ] 


AI'J . Au 

Bj[T(Pj) ] 

AT (ai-U2)T^ B.j(Tc)-Bj[T(Pj) ] 

AUj 

1 

(ai-a2) T^ 

[T(P.)-T ] 

T(Pj)Tc 5 c 


The sensitivity of rij to guess temperature errors is minimized 
by choosing a channel which minimizes u j , while at the same time 
sounds as deeply as possible into the atmosphere so as to maximize 

T(Pj)-T^. 


2 . 3 . 2 . 1.5 Dual Frequency Principle 

As stated earlier, if a set of channels, e.g., 4.3 ym channels, 
are used to construct the apparent temperature profile, and one of 
those channels, e.g., the surface channel, is used to get n. then 
the retrieved temperature equals the guess temperature at the charac- 
teristic level, in this case the surface. We see from Equation (14) 
that n determined from a 15 ym surface channel is less sensitive to 
guess errors than if determined from a 4.3 ym surface channel. Using 
the 4.3 ym channels to determine apparent temperature profile, and 
the 15 ym surface channel to determine n will therefore produce a 
retrieved surface temperature which is better than the guess (pro- 
vided other sources of error are sufficiently small) , The degree 
of improvement can be estimated by linearizing Equation (10) to give 


T(Pg) - T(Pg) hi5 - n ^ Ani5 


T(Pg) - T(Pg) 


^ 4 . 3 - ^"^ 4.3 


( 15 ) 


/s 

where T(Pg) is the retrieved surface, T(Pg) is the guess, T(Pg) 
is the actual temperature, and n is -the true n. The right-haL 
side of Equation (15) can be evaluated from Equation (14) to give 


Ts-Tc 


dnis 

_ ^^15 

e TgTc ^^ 2 . ~ 

^15 

^^4 3/u ^ 

1-x ^*V^15 

'"'>4.3 

^4.3 

Ts-Tc 

-£015 ] 

- ® _ 2 _ J 

^4.3 

- 1-x 


(16) 


Tc=-Tc 


15 


il=1.439, and ^ 3. The smaller the 


where x = e 

^ 2.5 

right-hand side of Equation (16), the more improvement of the re- 
trieved temperature over the guess. The right-hand side of Equation 
(16) varies from — ~ i 


n 
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3 as X approaches zero (T^, very cold com- 


pared to T^) to i as x approaches i (T^ almost the same as T^) . 
Therefore, with very cold (high) clouds, a factor of 3 improvement 
in initial guess temperature error can be obtained in this fashion, 
while for low clouds, the improvement becomes small. Table 6 gives 
evaluated from Equation (16) as a function of and T.-T . 


'4.3 


we see that at least 3 . of the guess error can be removed, (^^ 


.67) provided x is less than 0.6, i.e., the clouds are at leasi^0» 
colder than the surface. An iterative process, whereby J^CP) is 
used as t"+ 1 (p) to evaluate from equation ( 8 ) or ( 10 ), will 

further decrease dependence of the retrieved temperatures on the ' 
guess but is potentially sensitive to noise. 
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Table 6 . 


Potential Surface Guess Improvement Factor Using Infrared 

Only. 



T 

s 

=300 

T 

C 

.=280 

T 

.=260 

s 


X 


X 

Atii5 

X 

Ani5 

*"4.3 

HB 

*"4.3 


.90 

.90 

.88 

.88 

.86 

.87 


. 69 

. 72 

.65 

.69 

.61 

.66 


.51 

.59 

.46 

.56 

.40 

.52 


. 36 

.50 

.30 

.46 

.24 

.43 


2. 3. 2. 1.6 Determination of n - Microwave Channels 

An alternate approach to the determination of n involves the 
use of the microwave channels . This procedure has the advantage 
of being independent of the initial guess surface temperature, 
but has the disadvantage of being sensitive to computational micro- 
wave noise, i.e., errors in computed surface emissivity. To the 
extent that the latter is not significant, use of microwave channels 
to determine n is superior to use of 15u channels . 

One will have determined from Equation (9) a different temper- 
ature profile T^(P), depending on the choice of r\. Given this temp- 
erature profile, one can calculate the microwave brightness temper- 
ature R^(n) for a given channel, e.g., 15, the surface channel, 
according to Equation (3), assuming is known or has been determined 
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!( 

•I 

n. is chosen so that R. (n) = R/.- the observed microwave brightness 
temperature . 

The surface emissivity e^, can be determined according to the 
method of Waters et al. (1975) from the observations in microv/ave 
channels 1 and 2 , a knowledge of whether you are looking at land 
or water, and a guess atmospheric temperature. We have tested the 
procedure by comparison of brightness temperature observed near 
radiosondes with those calculated using the radiosonde temperature 
profile and the emissivity calculated from the observations. The 
resultant calculation shows small systematic differences with ob- 
servation, but with standard deviation lower than 1° K. Thi^ 
indicates that the microwave computational noise is not, in general, 
much worse than the instrumental noise of about K. The^ sys- 

tematic differences for each microwave channel were calculated for 
each of the summer and winter periods for five latitude zones. Tha 
systematic differences were subtracted from each observation in the ■ 
handling of the data according to channel, season, and zone. 

2 . 3.3 Use of Microwave Channels for Temperature Sounding ^ 

In addition to the determination of ri , the microwave chai^nel , 

17 (M5) is an excellent stratospheric channel having a sharp weighting 

/ 

function peaking at about 150 mb which can be used in temperature 
sounding, either in conjunction with infrared channels or with 
microwave alone. In the; case of microwave alone soundings, there 
are only three channels , I giving information at the surface, 500 mb, 
and 150 mb for the deterMnation of temperature profiles. To the 
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extent that tha shape of the Initial ,uess is correct, excellent 

tropospheric temperatures can be retrieved, provided the error in 

calculated surface emissivity is small. Features in the actual 

profile not in the initial guess will cause serious degradation of 
the results. 

2.3.^ Cloud Height Determination 

use of any of the three techniques described previously, 

(i.e., 4.3 ym channels to aet the i. 

u ger the apparent temperature profile and 

15 )jin cliciiiiiGls to cr 0 t n 4 um -i 

g n, 4.3 ym channels to get the apparent temper- 

ature profile, and microwave channels to get n, or microwave channels 
to get the temperature profile directly) will have produced temper- 
ature profiles Which are independent of assumption of cloud properties 
and basically the same as each other up to noise affects and slightly 
different vertical resolution, cloud height and percent cloud cover 
can now he determined from the observation and retrieved temperature 
profile from Equations ( 2 , and ,4), provided assumptions are now made 
about the Cloud properties. Clouds act as essentially blac)c bodies 
(t=l) in the infrared spectral region. The assumption of unit emis- 
y IS not valid enough for accurate temperature determination but 
rs sufficiently valid for determination of reasonable cloud parameters. 
If we assume a black cloud whose top is at with temperature T(P,,), 
Where T<P) ia the retrieved temperature profile, then Equation ,4) cln 
be evaluated at any assumed cloud top pressure to give 

'*l,cld<'’c' * ®lt’'(Pj,)lTi(P^) + /I B.(T)dt . (17, 

X c' ' 
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Using Equation (2) , a cloud fraction, consistent with the assumed 
cloud pressure, a^(P^), can be determined for channel i according to 



%,clr - Ri 
Ri,clr “ Ri, cld^^c) 


(18) 


where is the observation for channel i and Ri^dr is the calcu- 
lated clear column radiance using the retrieved temperature profile 
and equation (3). Channel i should sound as deeply into the atmos- 
phere as possible to maximize the numerator and denominator of 
Equation (18) and minimize the affects of errors. For any pair 
of channels, P^, and a can be determined such that aj^(Pj,) = Oj (p^) 

= a. 

2 . 3.5 Alternate Temperature Inversion Scheme 

An alternate inversion technique— the "Residual Error Method"— 
has been developed as a replacement for equation (1) . The procedure 
is an iterative process of perturbing an initial guess temper- 
ature profile such that the radiances computed from a set of 

radiative transfer equations approximately equals the corresponding 
set of measured radiances. 

^c ~ cloud top pressure 
^s ~ surface pressure 

~ pi^essure where radiances are measured 

^i - 1,.. .,N) = a set of measured radiances 
a = the cloud fraction 
T / 

(p) = an initial guess for the temperature profile 
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t(v^,P) = the transmission (for frequency v^) 

B = the Planck function 

PK.= the peak of the weight function dT^^/dlnp, where 


P(,<Pki<Pk2<---<Pk^ = P3 

A set of computed radiances is obtained using the initial 
temperature profile guess: 

P P 

R? = (1-a) °BdT)+ °Bdx) 


s s 


(19) 


(The determination of cloud parameters is essentially the same as 
in previous methods » and we omit discussion of them.) 

We seek a temperature profile for which 

I (R?-r"')/r"^1<e, (i = lp...,N) 

'1 11' 

for some given e. We describe the procedure graphically as shown 
ini Figure 13. 

( 1 ) ( 2 ) ( 3 ) 




Figure 13. Perturbation Procedures Used in Residual Error Method 
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Basic to our procedure is the fact that if T^(p)>T(p) for all 

p (P <P<P ), then R? (Tt ) >R? (T) . The first step (chart 1) is to 
os X 1 1 

rotate T(p) about P^ to obtain T^(p) such that 

T^(PK^) = T(PKjj)+AT , 

where AT is some positive or negative quantity accordingly as 
me 

Rj^-Rj^(T) is positive or negative. We repeat this process until 

m C TTJ 

we find that the signs of Rj^-R^(T^) and R^-Rj^(T^_^) differ. We 

then interpolate to find the AT such that R^-R^(Tj^j^) = 0, where 

T. ^ is a rotation of T . , such that 
1+1 1-1 




Tj-^(PKj,)+AT. 


Our next step (chart 2) varies from the first step only 

in that we perturb T^^^(p) (our current temperature profile) by 

rotations from P^ (above PK_) and from P (below PK.,). Upon 
o ^ s 2 ^ 

completino| step 2 and obtaining a new temperature profile T(p) 
such that ^ ™ 
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we have put an error into Equation 19 {for i = 




N) , i.e. , 


R^(T) ^ . 


If the weight functions had sufficiently sharp peaks, then the 
xntegrals R? would be almost independent of perturbations of T(p) 
outsxde of a small interval about the corresponding PK. . This 
leads us to an iterative process. After applying our perturba- 
tion method (as per chart 2) to obtain the required R?*s 
(i’ = N,N-1, . . . ,2) and obtaining rJ = according to chart 3, 
where the perturbations above PK^ are linear shifts, we repeat 
the entire process until we obtain max | (R?-R?)/r'!’| <e (for i = 
1,2,...N) for some given e 


Prelxnunary indications show that improvements can be made 
over the old iterative scheme in the far north where inversions at 
850 mb have been determined through use of this method. 
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2.4 6ISS OPERATIONAL PROCEDURES FOR DATA REDUCTION 


The basic operational procedures used at GISS for temperature 
retrieval were described in Susskind et al. (1977) . Temperature 
retrievals are done at the GISS gridpoints using averaged radiances 
over the grid area for each channel. Initial guesses for the re- 
trievals are taken frora a 12-hour forecast. The retrieved temper- 
atures are considered to be typical of the entire grid area and 
are used for assimilation into the model at the grid points. To 
implement the dual field of view retrieval scheme, spots falling in- 
to a grid area were ordered according to the ratio of the observed 
radiances of channel 7 to channel 5 for either the VTPR or HIRS 
obwervations . Those spots lying in the half with the highest ratio 
form the relatively clear field of view; the remainder the relatively 
cloudy field of view. This procedure is used so as to maximize con- 
trast between the fields of view (minimize n from Equation (7)) and 
also provide the greatest homogeneity of temperature profiles in the 
field of view. The ratio is used to account for the dependence of 
radiance on the zenith angle of the observation (the radiance is 
roughly linear with the secant of the angle for uniform temperature 
profiles along the scan line). In the winter DST period, HIRS chan- 
nels were very noisy and not suitable for use. The spots were then 
ordered in terms of the observed radiance for channel 8, the 4.3 ym 
surface channel. The effective zenith angle for each field of view 
is determined according to the arc secant of the average secant of 
the zenith angle of each -^pot included in the field of viev/. 

This is needed for cal ’ulation of effective atmospheric trans- 
mission functions for each field of view. The SCAMS brightness 
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temperatures are averaged into only one field of view because 
they are not affected by clouds. The HIRS radiances are taken 
from the output of the NESS operational INGEST program. The 
SCAMS observations obtained from the INGEST program are antenna 
temperatures and differ by 1° to 2° from the needed brightness 
temperatures. We obtain the brightness temperatures from a 
program by Dr. Rosenkrantz at M.I.T. which makes appropriate 
corrections to the antenna temperatures. The brightness 
temperatures are expected to have further small systematic errors 
due to calibration. Systematic errors determined as described 
in the text are subtracted from the brightness temperatures before 
use. The systematic errors are actually systematic differences 
between observation and calculation and therefore are region 
dependent. 

2.5 DETERMINATION OF TEMPERATURE PROFILES 
2.5.1 VTPR 

As shown in Figure 1 and Table 1, VTPR has six IS-ym tempera- 
ture sounding channels, 2 through 7, sounding progressively deeper 
in the atmosphere. Because the sounding channels are all in the 
15-Mm region, cloud effects cannot be filtered out and retrievals 
are strong functions of the initial guess in the lower troposphere. 
If, after apparent temperature profiles are obtained, is 
determined according to Equation (10) and used in Equation (9) , 
the retrieved temperature matches the guess at the surface. If 
Hs is determined and used, the retrieved temperature matches the 
guess at 700 mb. If, in fact n-^^rig. then the retrieved temperature 
matches the guess from 700 mb to the surface. In general and 
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Dg are slightly different because of noise and guess errors. 

To cancel out noise somewhat, n is chosen as r| = l/2r\^ + 2/3n^. 

This has the property of closely matching the guess near 850 mb. 

Redundant or Highly Overcast Field of View. As shown in 
equation (9), the larger ti » the more extrapolation must be done 
from the apparent temperature profiles to the true one. The pro- 
cedure is thus more sensitive to noise. Also, the further the 
apparent surface temperature in the clear field of view is from 
the true (or approximately, the forecast) surface temperature, 
the more extrapolation is needed. To guard against extreme cases, 
the dual field of view approach is not done if n>3 or if the 
apparent surface temperature is more than 30° colder than the guess 
surface temperature. The former case corresponds to redundant 

fields of view (a 2 < 4/3al) and the latter corresponds to highly over- 
cast conditions or very cold clouds. In either of these cases, a 
single field of view retrieval is done as described in Susskind 
et al. (1977) . 

2.5.2 NIMBUS-6 Sounders 
2. 5.2.1 Overview 

As seen in Figures 2 to 4 and Table 1, the HIRS-SCAMS sounder 
complex has many potentially redundant temperature sounding chan- 
nels. Because of cloud effects, the lower tropospheric 15-ym 
channels on HIRS, channels 5 through 7, can only be used for deter- 
mination of n . Channel 1 was always extremely noisy and not 
usable. Channel 2 through 4 are potentially usable for stratospheric 
sounding. The tropospheric 4.3 ym channels on HIRS, 8 through 10, 
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have signals coming from relatively sharp portions of the atmosphere 
(see figure 3b) and have the potential of high vertical resolution 
in the lower troposphere. The channel 10 radiance does have non- 
negligable contribution from above 10 mb, however, and is potential- 
ly affected by non-thermodynamic equilibrium near 4.3 yra in the 
upper stratosphere. Channels 11 and 12 are affected to even 
greater extents. Channel 11 also receives its signal almost 
uniformly over the entire atmosphere so as to be essentially 
useless for temperature soUinding. The microwave has, aside from, 
two surface channels necessary to determine surface emissivity 
(and humidity and liquid water content) , channels sounding at 
1000 mb, 500 mb, and 200 mb. The stratosopheric channel, M5 (also 
called 17) is the sharpest stratospheric channel in the HIRS-SCAMS 
complex. The tropospheric channels can be used for cloud filtering 
in conjunction with the 4.3ym channels or alone for temperature 
profile determination. 

We have considered the three different systems — HIRS alone, 
SCAMS alone, and combined HIRS/SCAMS soundings to assess the 
information content and accuracies of infrared and microwave 
sounders used separately or in conjunction with each other. In 
actuality, we were primarily concerned with accuracies of tropospheric 
soundings. Because these are affected somewhat by stratospheric 
temperatures, a common set of stratospheric channels was used for 
all the experiments. Slightly different techniques were developed 
for the winter DST period because of the poor quality of the 15ym 
channel soundings during this period. The summer period will be 
discussed first. 
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2. 5. 2. 2 Stratospheric Sounding Channels 

The best set of stratospheric sounding channels for the 
summer period were found to be channels 2 (15 ^ud 17 (micro— 

v/ave) sounding at 50 mb and 150 mb. Channel 12, sounding at 
2 mb, was found to be slightly erratic, possibly due to the affects 
of non- thermodynamic equilibrium which were not taken into account 
in analysis of the data. Channels 3 (70 mb) and 4 (250 mb) were 
found to be too close to channel 17 to produce stable solutions. 
Channel 4 has the additional problem of cloud contamination for 
high clouds. 

2. 5.2.3 Tropospheric Sounding and Cloud Filtering Channels 
2. 5. 2. 3.1 Microwave Alone 

The microwave alone sounding system consists of channels 2, 

17, 16, and 15. The main problems are the effects of surface 
emissivity and the low tropospheric resolution. The the extent 
that the emissivity is calculated accurately and the initial 
guess has the correct shape between 1000 and 500 mb, in particular, 
the proper lapse rate between 1000 mb and 850 mb, accurate tempera- 
ture retrievals will be obtained. If, for example, the true profile 
has a temperature inversion at 850 mb that is not present in the 
guess, or vice versa, there is no way that it can be determined 
from the observation, and, in general, the result will be poor re- 
trieved temperatures at 850 and 1000 mb. 

The procedure for analyzing microwave only data is to obtain 
the apparent temperature profile for the single field of view using 
the characteristic pressure for each channel to be the peak of its 
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weighting function. Five iterations are performed, and the 
procedure is then terminated. To guard against very poor retrievals, 
possibly due to poor surface emissivity, the retrieval is rejected 
if the retrieved surface temperature differs from the forecast by 
more than 6 ° K. This quality control is also used with all other 
retrieval schemes which do not match retrieved surface temperatures 
to the surface guess. 

2. 5 . 2. 3. 2 HIRS Alone 

The HIRS alone temperature retrieval system consists of 
channels 2, 17, 10, 9 and 8 for apparent temperature profile and 
6 and 7 (15 ym channels) for determination of n* The characteris- 
tic pressures for channels 10 and 8 are taken at the peaks of B 
times the weighting function, typically 650 and lOOOmb, with the 
pressure for channel 9 set halfway between those of 10 and 8 . The 
characteristic pressure for channel 10 is never allowed to go be- 
neath 700 mb. Apparent temperature profiles are obtained from 
the initial guess for each field of view. r)g^*^-and ^ 7 ^^^ are calcu- 
lated from Equation ( 8 ) , using the initial guess temperature pro- 
file. A new temperature profile is obtained by applying Equation 
(9) at the characteristic pressures. To help account for possible 
multiple cloud layers with different effective n as a function of 
height, y is chosen as a function of 05 and Hy for different 4.3 ym 
channels. pg is taken as . 75 ri 7 + .25hg, hg =. 5 ( 0 ^ + hg) , and = 
.25y7 + . 75115 . Temperatures between the characteristic levels are 
obtained by a shape-preserving interpolation from the initial guess 
(Susskind et al, 1977) . As described previously, n calculated from 
Equation ( 8 ) and T^, calculated from Equation (9), are somewhat de- 
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pendent on the initial guess, particularly if the cloud temperature 
IS close to the surface temperature. To minimize this dependence, 
the procedure is iterated five times, using the retrieved profile 
from Equation (9) to calculate 15 ym radiances to be used in Equation 
(8) to calculate new n's, which in turn provide a new profile from 
Equation (9). The apparent temperature profiles are not iterated. 

Quality Controls. The HIRS retrievals have the advantage 
over the SCAMS retrievals in that variable surface emissivity is 
not a problem and the the retrievals have the potential of finding 
structure in the lower troposphere, i.e., a different shape profile 
between 1000 mb and 500 mb than was found in the guess. HIRS has 
the disadvantage of being affected by clouds. To filter out clouds 
n must be determined, and in turn multiply a difference in apparent 
temperatures. The larger the value of y , or the difference in ap- 
parent temperatures, the further one has to extrapolate in Equation 
(9) to get the correct temperature and the more sensitive one is 
to noise and other errors. To protect against this, HIRS retrievals 
are rejected if y>5 and the apparent surface temperature in the 
clear field of view differs from the initial guess surface temper- 
ature by more than 3°, or, if the apparent surface temperature in 
the two fields of view differ from each other by more than 15® but 
less than the difference between the clear apparent surface temper- 
ature and the initial guess. The first case signifies redundant 
information (but not clear) , while the second signifies highly over- 
cast, even in the clear field of view, with insufficient discrimina- 
tion between fields of view, if n>5 and the apparent "clear" surface 
temperature is within 3° of the guess, the fields of view are treated as 
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completely clear and n is taken as zero, i.e., the clear field 
of view temperature profile is taken as the solution. Another 
potential problem in retrievals using 4.3 ym channels is the 
effect of a "hot" surface due either to reflected solar radiation 
or ground temperatures which are considerably warmer than the 
air at the surface. The HIRS sounder does not have sufficient 
information to distinguish ground temperatures from surface air 
temperatures (two 3.7 ym window channels are needed for this) and 
the two temperatures are assumed equal in the calculation. Large 
differences produce very warm apparent surface temperatures. To 
protect against this, all cases are rejected where the apparent 
surface temperature in the clear field of view is 8“ greater than 
the guess temperature. If the apparent surface temperature is 
between 3° and 8° greater than the guess, the case is not re- 
jected but treated specially in that n is allowed to become very 
negative, thus possibly giving temperatures colder than those 
in the "cloudy" (cooler) field of view. Ordinarily, n is not 
allowed to be less than -.2. A last additional criterion for 
rejecting a sounding arises if the iterative procedure for 
calculating apparent temperature profile does not converge within 
15 iterations for either field of view. 

2.5.3 Results of HIRS and SCAMS Retrievals 

Global HIRS alone and SCAMS alone temperature retrievals 
with a 12 hour forecast initial guess were run using the techniques 
described. Figures 14 to 16 show locations of successful (that is, 
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passed all the quality tests described) satellite retrievals for 
three orbits. Successful retrievals represent about 8o percent of 
all possible retrievals for SCAMS and about 55 percent for HIRS. 

A majority of the unsuccessful HIRS retrievals occur over land during 

the day where reflected solar radiation and/or hot surfaces cause 
errors. 


The quality of retrieved temperature profiles can be judged 
by comparison of retrieved temperatures with radiosonde colocated 
in a space txme window. Table 7 shows the results of comparing 
the retrievals over water with radiosonde colocated within - 110 km, 

- 6 hours during the period August 18 to September 1. The large time 
window was chosen so as to minimize overlap in time between satellite 
and radiosonde coverage. The chart shows, for each pressure level, 
the RMS error of retrieved temperature compared to radiosonde, the 
RMS error of the initial guess compared to radiosonde, and the correla 
tion coefficient of guess and retrieval errors. Also shown are the 
total number of colocated retrievals included in the statistic. 

Results are shown for two sets of retrievals for each instrument, 

using either a 12-hour forecast or a zonally averaged climatology 
initial guess. 


The quality of the forecast in the lower troposphere in the 
vicinity of radiosondes is seen to be much better than climatology. 
The forecast is of unknown quality in the data-sparse regions where 
satellite retrievals are most significant and probably no better 
than climatology. The results of the two retrievals give an idea 


of the accuracies of retrievals near radiosondes and away from 
radiosondes where, preseraably, zonally averaged climatology is a 
good a guess as near radiosondes. 
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Table 7. Temperature RMS Errors ana Correlation Coefficients vs. Height 

Water, +6 hrs , +110 km, 18°N - 7C° N, DST Summer (Aug 18-Sept 1) 


Pressure 

(mb) 

SCAMS 

HIRS 

HIRS/SCAMS 

— 
Fore . 

dim. 1 

Fore . 

dim. 

Fore . 

dim. 

1000 

2.77 

3.06 

2.73 

2.73 

2,68 

2.78 


2.13 

3.72 

1.99 

3.37 

2.07 

3.82 


.48 

.33 

.38 

.19 

.46 

.36 

850 

2.42 

2.50 

2.39 

2.53 

2.26 

2.36 


1.82 

3.65 

1.67 

3.27 

1.78 

3.63 


.55 

.36 

.50 

.48 

.59 

.44 

700 

1.92 

1.87 

1.99 

2.05 

1.84 

1.82 


1.71 

2.95 

1.54 

2.66 

1.71 

2.92 


.63 

.33 

.39 

.26 

.62 

.35 

500 

1.80 

1.85 

2.04 

1.93 

1.88 

1.85 


1.79 

3.08 

1.67 

2.70 

1.78 

3.08 


.69 

.42 

.46 

.36 

.64 

.38 

400 

2.13 

2.24 

2.05 

2.13 

2.20 

2.25 


2.19 

3.56 

2.07 

2.19 

2.20 

3.52 


. 87 

.74 

.70 

.76 

.84 

.73 

300 

2.08 

2.97 

2.40 

3.01 

2.19 

2.96 


3.01 

3.77 

2.81 

3.44 

2.93 

3.76 


.80 

.91 

.74 

.88 

.75 

.90 

250 

2.32 

3.01 

2.56 

2.88 

2.41 

2.95 


2.49 

4.95 

2.33 

4.27 

2.44 

3.71 


.87 

.85 

.73 

.82 

.80 

.84 

200 

2.94 

3 ., 32 

3.09 

3.15 

3.02 

3.22 


3.71 

4 .39 

3.61 

4.58 

3.73 

4.45 


.91 

.93 

.75 

.84 

.83 

.90 

150 

2.66 

2.87 

2.75 

2.81 

2.66 

2.78 


3.70 

4.65 

4.02 

4.77 

3.70 

4.72 


.77 

.78 

.65 

.66 

.71 

.73 

100 

2.36 

2.54 

2.41 

2.50 

2.37 

2.57 


3.19 

4.43 

3.44 

4.27 

3.19 

4.59 


.73 

.75 

.76 

.74 

.75 

.76 

70 

2.06 

2.27 

2.12 

2.22 

2.05 

2.23 


3.36 

3.13 

3.79 

3.04 

3.50 

3.25 


.71 

.70 

.70 

.78 

.69 

.73 

50 

2.13 

2.09 

2.01 

2.03 

2.06 

1.95 


2.80 

3.04 

2.82 

3.29 

2.89 

3.14 


.83 

.68 

.75 

.75 

.77 

.68 

Colocations 

505 

493 

316 

280 

548 

536 
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The quality of retrievals between 1000 and 400 mb, using a cli- 
matology guess, is only slightly degraded over that with the fore- 
cast guess indicating that retrievals are essentially guess-independent 
The errors are also shown to be only slightly correlated with the guess 
HIRS only retrievals are somewhat better than SCAMS retrievals at 
the surface, especially with a poor guess, and somewhat worse at 
5 GO to 700 mb. The surface errors in SCAMS retrievals are partly 
due to errors in surface emissivity and partly due to errors in the 
shape of the initial guess between 1000 and 500 mb, especially with 
regard to the 850-mb temperature. The errors in HIRS come in part 
from cloud problems, errors in physics (i.e., transmission functions, 
effects of water vapor, surface emissivity and reflectivity), and 
also from the fact that three channels are being used to determine 
structure in the lower troposphere, when, in general, the solution 
in the upper troposphere (whose temperatures effect the radiances 
of the HIRS 4.5 ym channels as much as detailed structure in the 
lower troposphere) is not known very well. 


AS observed from Table 7, the retrieved temperatures in the 
range 300 to 200 mb are considerably poorer than elsewhere and 
are marked by high correlations with the guess errors. This is 
because there is little direct information about this portion of 
the atmosphere in the radiances. The major difference in the qual- 
ity of forecast and climatology guess retrievals also occurs in this 
region, because the poor climatology guess cannot be corrected ade- 
quately. Prom 150 to 50 mb, the retrievals are again good and 
comparable because of the channels sounding roughly 150 mb and 50 mb. 
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2.5.4 Combined HIRS-SCAMS Retrievals 


Combining the HIRS and SCAMS observations into one sounding 
helps to alleviate some of the problems of either instrument. The 
HIRS retrieval is somewhat guess-dependent in its calculation of 
n. Therefore, a microwave retrieval is performed first to give a 
reasonable temperature profile to be used as the initial guess for 
the HIRS retrieval. This guess is used to calculate the HIRS 
transmission functions, which are fairly temperature-dependent; 
as a first guess to give apparent temperature profiles, and to 
compute Hg and n^. The apparent temperature profiles are 
constructed as in the HIRS alone case with characteristic pressures 

nominally luOO, 800, and 600 mb in the troposphere. While, as in 
the HIRS, there is little information in the upper stratosphere, 

this region has already been significantly improved over the initial 
guess by the microwave retrieval using the 500-mb channel. Thus, 
structure determined by the HIRS channels in the lower troposphere 
will be less effected by temperature errors in the upper troposphere 
and tend to be more accurate. Some of the inaccuracy in retrieved 
surface temperatures from SCAMS, due to errors in microwave emissiv- 
ity, is removed by using the 15 pm channels to determine n- In 
this case, only one iteration on n is performed to minimize the 
effects of noise (observational and computational) on the 15 pm 
channels. This returns a surface temperature somewhat correlated 
to (but not identical to) the microwave temperature. Improvements 
are often of the order of 3° to 4° in cases of poorly deter- 
mined surface emissivity. A second iteration on n is done to 
check the consistency of the infrared and microwave channels. 
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If the second iteration on n produces a surface temperature 
that does not pass the basic guess consistency check, i.e., 
differs from the guess temperature by more than 6“, the combined 
retrieval is rejected. The combined retrieval is also rejected 
for any of the reasons that pertain to HIRS alone soundings . In 
case the combined retrieval is rejected, the SCAMS alone retrieval 
is used provided it, too, does not fail the basic test. 

Statistics for the combined retrievals are also shown in 
Table 7 . The basic error structure of the retrievals is similar 
to HIRS or SCAMS alone but the results indicate the best qualities 
of each in that the yield is even larger than that of the microwave 
alone sounder, the 1000 mb and 850 mb temperatures are more accurate, 
especially with a poor guess, and the 700 mb and 500 mb retain the 
accuracy of the SCAMS measurements . 

2,5.5 Comparison- OF VTPR and NIMBUS Soundings 

Table 8 shows a set of similar statistics for the VTPR sound- 
ings. Figures 17 and 18 show the results of Table 8 along with those of 
the combined NIMBUS sounders . Unlike the NIMBUS soundings , the qual- 
ity of the retrievals is closely tied to that of the guess from 700 mb 
ttj 1000 mb with error correlation coefficients close to 1. This is 
because the instrument has no capability of measuring lower tropospher- 
ic temperatures independent of outside information. Only in the region 
300 mb to 200 mb, where NIMBUS has very little information, does VTPR 
show an improvement over NIMBUS results. Because real sounding abil- 
ity is absent in the lower troposphere, the VTPR sounder alone is 
not a practical instrument. 
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ElS 


^•73 




Height 

(mb) 

Frcst 

Guess 

Clim 

Guess 

1000 

2.07 

3.07 


2.07 

3.26 


.79 

.87 

850 

1.90 

2.65 


1.82 

2.68 


.96 

.96 

700 

2.06 

2.71 


1.75 

2.59 


.85 

.86 

500 

1.77 

2.36 


1.74 

3.16 


.72 

.75 

400 

2.15 

2.35 


2.21 

3.58 


.74 

.66 

300 

2.15 

2.53 


2.96 

3.55 


.57 

.68 

250 

2.65 

2.60 


2.61 

4.04 


.80 

.69 

200 

2.54 

2.85 


3.29 

3.77 


.88 

.91 

150 

2.35 

2.25 


2.91 

3.52 


.71 

.73 

100 

2.47 

2.41 


2.73 

3.34 


.76 

.74 

70 

2.17 

2.33 


3.27 

2.93 


.65 

.81 

50 

2.20 

2.47 


2.68 

2.81 


.69 

.73 
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2.5.6 NIMBUS 6 Soundings in the Winter DST Period 

During the winter DST period, the 15 ym channels of the HIRS 
instrument became too noisy for use. Therefore, procedures had to 
be modified so as to use only the 4.3 ym HIRS channels and the SCAMS 
channels. The major consequence of this is that HIRS alone retrievals 
become impossible because of lack of cloud filtering ability. A 
secondary consequence is that no analogue of the combined summer 
retrieval procedure is possible in the winter. 

2. 5.6.1 Winter Retrieval Procedures 


The winter retrieval procedures used are basically similar to 
those in the summer. The 4.3 ym channel 12 sounding at 2 mb was 
used in place of the 15 ym channel 2 for sounding the upper strato- 
sphere. Microwave retrievals were run just as in the summer but 
using the channels 12, 17, 16, and 15. Combined microvave-infra- 
red retrievals were run with channels 12, 17H 10, 9, and 8 for con- 
struction of apparent temperature profiles. Channels 16 and 15 
were used for determination of n as described in Section 2. 3. 2. 1.6. 

The infrared apparent temperature profiles are modified in a manner sim- 
ilar to that using the 15 ym channels for n. The appropriate n's 


to be substituted into Equation (9) for channels 10, 9, and 8 are: 


.75015 + '^^^16' *^9 ^ '''l6^ ^ 


.25nj^5 + .75rij^g. 


In the winter runs, the characteristic pressures of channels 
8, 9, and 10 were taken to be 1000 mb, 700 mb, and 400 mb, in- 


dependent of temperature profile. Using the summer procedure 
of putting the characteristic pressures at the peak of the 


Planck-weighted weighting function, nominally 1000, 800 , and 600 
mb, produced substantially worse retrievals. The summer procedure 
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has the advantage of giving potential increased resolution in the 
lower troposphere, but has the disadvantage of producing spurious 
structure as a result of noise in the measurements or errors rn the 
upper tropospheric initial guess. Probably a combination of increased 
problems in the winter due to larger errors from both sources made 
■the t6chnique irnpractical. 


2. 5, 5. 2 Results of Winter Retrieval 


Table 9 gives statistics for temperature retrievals over water 
for the winter period compared to radiosondes colocated within 110 km 
and 6 hours. Statistics for the SCMS alone and combined HIRS/SCAMS 
retrievals are similar to each other. As in the summer, the quality 
of the retrievals is not highly dependent on that of the initial guess. 
The .5" degradation in the quality of retrieved temperatures at 850 
and 700 mb using a climatology guess should be guaged against the 
4.3” degradation in RMS error in the guess temperatures. 

A different indication of the quality of the soundings is 
given in Table 10. Here detailed results are presented for two 
HIRS/SCAMS soundings colocated with radiosondes tl hr, ±.75” latitude, 
longitude. The column labeled ADP gives the radiosonde temperature 
report at a pressure level. The columns labeled T Sol and Diff 
give the retrieved temperature profile and the error compared to 
radiosonde. The columns labeled T Guess and Diff give the initial 
(climatology) guess and its error compared to radiosonde. The 
highest pressure shown is the radiosonde surface pressure. Also 
shown are the apparent 4 . 3-um temperatures in each field of view 
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Table 10 


SELECT WINTER HIRS/SCAMS RETRIEVALS 


LATITUDE 58. 


PRES 

ADP 

50.0 

202.9 

70.0 

202.7 

100.0 

204.1 

150.0 

207.9 

200.0 

204.1 

250.0 

208.1 

300.0 

217.1 

400.0 

232.1 

500.0 

243.7 

700.0 

263.7 

850.0 

991.0 

269.7 


STATION NO. 03026 
REGION 1 


T SOL DIFF 


204.6 

1.7 

204.9 

2.2 

205.0 

0.9 

205.8 

-2.1 

208.6 

4.5 

211.5 

3.4 

216.8 

-0.3 

232.7 

0. 6 

246.7 

3.0 

266.1 

2.4 

272.6 

2.9 


LONGITUDE 6, 


T GUESS 

DIFF 

214.0 

11.1 

214.8 

12.1 

215.4 

11. 3 

217.0 

9.1 

215.9 

11.8 

214.8 

6,7 

217.0 

-0.1 

227.9 

-4.2 

238.1 

-5.6 

253.0 

-10.7 

257.7 

-12.0 


STA. RMS 2.50 yTA. RMS 9.39 

AVE. RMS 2.50 AVE . RMS 9.39 


■' 15 - 2-02 
ri2^g=l. 06 
Tj^ (850) =262. 3 
T2f850)=253.0 


LATITUDE 54. 


ADP 


20.0 

214.5 

30.0 

211.5 

50.0 

208.1 

70.0 

210.5 

100.0 

208.9 

150.0 

210.9 

200.0 

208.5 

250.0 

211.5 

300.0 

220.5 

400.0 

234.9 

500.0 

244.7 

700. 0 

262.1 

850.0 

985.3 

27 0.7 


STATION NO. 03920 

REGION I LONGITUDE 6. 


T SOL 

DIFF 

209.4 

0.0 

209.4 

0.0 

209.1 

1.0 

209.5 

-1.0 

209.8 

0.0 

210.7 

-0.2 

212.2 

3.7 

213.2 

1.7 

217.2 

-3.3 

231. 6 

-3.3 

244.5 

-0.2 

263. 6 

1.5 

271.4 

0.7 


T GUESS DIFF 


214.7 

0.0 

215.2 

0.0 

215.4 

7.3 

216.3 

5.8 

216.9 

8.0 

218.3 

7.4 

217.1 

8.6 

215.3 

3.8 

217.1 

-3.4 

227.9 

-7.0 

238.5 

-6.2 

253.4 

-8.7 

258.7 

-12.0 


nig = .i6 

T^(850)=268.2 


T 

2 


(850)=265.3 


STA. RMS 2.00 
AVE. RMS 2.25 


STA. RMS 7.47 
AVE. RMS 8.43 






at the fxrst radiosonde level above the surface (in both cases 850 
mb) and n determined from each microwave channel. 

The first case represents a highly overcast situation in that 
the apparent 850-mb temperatures in each field of view are consider- 
ably colder than the actual temperature. The retrieved lower trop- 
ospheric temperatures, using n determined from the microwave obser- 
vations, gave good, but slightly too warm, retrievals, indicating 
Hg being too large. Evidently, was too large, most likely due 

to surface emissivity errors. A microwave only retrieval would then 
have given even larger positive errors in retrieved surface temper- 
ature. Mixing into rig improved the quality of the retrieval. 

The second case is clearer as the apparent temperatures in 
the two fields of view are closer to each other and to the true value 
Again n determined from the microwave gave very good lower tropospher 
1C temperatures. Stratospheric temperatures are also very good. 

The improvement over the bad guess in the region 200-300 mb is 
smaller, however, because of lack of specific information in the 
soundings for this region. 

2.5.7 Comparison of Quality of Winter and Summer Soundings 

A comparison of Tables 7 and 9 appears to indicate significant 
differences in the quality of winter and summer retrievals with a 
general degradation of about .3°. The quality of the 12-hour fore- 
cast guess compared to radiosondes appears also to be significantly 
poorer in the winter from 500 mb to the surface. This may be due 



H 


either to an actually poorer forecast near radiosondes or alterna- 
tively to larger spatial and temporal variability in the winter 
within the space-time window, causing a degradation in the Interoom- 
parison between forecast and radiosonde values. The latter possibil- 
ity applies equally well to comparisons of retrieved temperatures 
with radiosonde measurements in the lower troposphere. Therefore, 
the degradation in quality of winter retrievals may in fact be less 
than is apparent from Tables 7 and 9 , at least with regard to SCAMS 
alone retrievals. In the summer, an additional significant improve- 
ment in lower tropospheric retrievals was obtained by combined use 
of HIRS/SCAMS channels, which was not possible in the winter. 


2,6 ASSESSMENT OF RETRIEVALS IN THE ARCTIC 

Satellite temperature retrievals over the Arctic Ocean are very 
important because there is a general lack of conventional data in 
this region. There has been some question on the quality of satel- 
lite retrievals over the Arctic Ocean, especially during the summer, 
because during that period this region is generally covered by low- 
lying stratus clouds, which would potentially degrade (or worse yet 
prevent one from doing) infrared temperature soundings . The quality 
of microwave soundings was also questioned because the ocean is cov- 
ered by broken sea-ice whose surface emlssivlty in the microwave is 
extremely variable. As described in the theory and implementation 
sections, the effects of clouds and surface emissivity can, in prin- 
ciple, be determined form the observations, provided the field of 


2-64 


view is not completely overcast (over a 400-km grid) . We have con- 
ducted a special study over the Arctic, both because of the signifi- 
cance of retrieved temperatures there for Arctic studies and to 
determine the adequacy of the algorithms developed for cloud filter- 
ing and surface emissivity under trying conditions . 

Because of the general lack of conventional data, it is difficult 
to assess the quality of the temperature soundings. We have taken 
the approach of comparing surface temperatures retrieved by infrared 
alone and microwave alone to determine if either of these problems 
is in fact degrading the quality of our results since each problem 
would have its largest effect on the retrieved surface temperature, 
but in a different way. 

The RMS difference for the colocated retrieved HIRS and SCAMS 
surface temperature over ocean between 65°N and 85°N is roughly 3°. 

This result is independent of the use of a forecast or climatology 
guess. Since RMS differences between 1000 mb retrieved temperatures 
and radiosonde reports is of the same order of magnitude globally, 
it is considered that Arctic retrievals are of comparable quality 
to those elsewhere. 

Another assessment was made by looking at the 2-week averaged 
retrieved surface temperatures in the 65^N to 85 °N region for both 
the HIRS and SCAMS retrievals. These are shown in Tables 11 and 12 , 
which have for each grid point the average 2-week surface temperature. 
Its standard deviation, and the number of observations entering into 
the statistic. The area enclosed by the line indicates land. The 
remaining area is water. The grid index going from 39 to 44 repre- 
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Table 11. SCAMS Surface Temperatures 
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Table 12. HIRS Surface Temperatures 
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sents latitude from 62®N to 82°N. The index from 2 to 36 to 72 repre- 
sents longitude from 170®W to 0 to 180°E. A comparison of the two maps 
shows good agreement in general, but in some areas the microwave re- 
trievals are systematically 3® to 4° warmer. This could be due to 
cloud or emissivity (or other) problems. It is also apparent that 
the microwave retrievals are too cold over Greenland [roughly (40-43) , 
(28-30)], causing most retrievals to be rejected. The source of this 
problem is being investigated. 

Nevertheless, except for some special cases, the agreement be- 
tween HIRS and SCAMS surface temperatures indicates that retrievals 
are of generally good quality over the Arctic. 

2.7 CLOUD HEIGHT RETRIEVALS 

Equations 17 and 18 indicate the procedures developed for cloud 
height determination. Cloud heights and fractions were retrieved 
using first the 15-ym channels 6 and 7 and then the 4.3-ym channels 8 
and 10 [8 and 9 produced redundant curves of a (p^,) ] . Each determin- 
ation is essentially independent of the other. 

Table 1.3 shows a comparison of determined from the 4.3-ym 
channels versus P^ determined from the 15-ym channels. /In the cal- 
culations, P^ was not allowed to be less than 200 mb or greater than 
700 mb. Most cases lie between the lines indicating agreement to 
better than 50 mb. Table 14 shows a comparison of a determined from 
the 15-ym channels compared with that from the 4.3-ym channels, both 
computed using the average cloud pressure determined from the 15-ym 
and 4.3-ym channels. In this case, there is a clear bias toward 
slightly lower cloud fractions determined from the 4.3-ym channels. 
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This is consistent with the fact that black clouds were assumed in 
the determination of a. This assumption is valid in the 15-ym re- 
gion, but clouds in the 4.3-vini region have transmissivities greater 
than zero (emissivity less than 1) , and the apparent cloud fraction 
(assuming emissivity equals 1) is less than the true value. 
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Table 14 

DISTRIBUTION OF ALPHAS COMPUTED FOR 4.3 MICRON CHANNELS VS. ALPHAS FROM 15 MICRON CHANNELS 
ALPHAS FROM 4.3 ON HORIZONTAL SCALE. ALPHAS FROM 15 ON VERTICAL SCALE. 
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2.8 COMPARISON OF GISS AND NESS NIMBUS 6 RETRIEVALS 

A detailed study of the relative characteristics of GISS 
and NESS retrievals with regard to yield.., accuracy, and 
ability to retrieve features of meteorological interest has 
not been made at this time. This section will present some 
rough statistics to indicate the general comparable guality of 
retrievals using both methods. 

2.8,1 Yield 

When making comparisons of yield of both retrieval schemes, 
it must be borne in mind that NESS retrievals are done globally 
over a 300 km grid, corresponding to roughly 2.5° x 2.5° at the 
equator, while GISS retrievals are done at a 4° latitude x 5° 
longitude grid globally (above 66°, the grid is 4° x 10°) . As a 
result of this, global coverage gives a potential of roughly 3 times 
as many soundings on the NESS grid than on the GISS grid. Tables 

2 ana 3 show typical NESS yield to be 570.0 retrievals per day. 

The typical yield of GISS soundings is 4800 retrievals per day, 
or roughly 85% of grid points observed by the satellite. 

Tables 15 and 16 give the latitudinal breakdown of GISS and 
and NESS retrievals colocated with radiosondes, +6 hours, over 
land and water , and over water alone , for the DST 5 and DST 6 
periods. The ratio of all GISS/NESS retrievals in a latitude 
band is most likely similar to the ratio of those colocated with 
radiosondes as shown in the tables . The relative distribution of 
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Table 15. DST-5 Zonal Colocations of GISS and NESS Retrievals to Radiosondes 

August 18 to September 1 
+6 Hours, Land/Water and Water Only 
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Table 16. 


DST-6 Zonal 


Colocations of GISS and NESS Retrievals to 
January 29 to February 12 
+6 Hours, Land/Water and Water Only 


Radiosondes 
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18/30 

30/40 

South 

40/50 

50/60 

60/70 

Total 

Land/Water 

GISS 

421 

1369 

579 

518 

264 

100 

38 

42 

1 

6 

11 

3349 


NESS 

579 
f-'.. ■ 

1006 

918 

600 

438 
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22 

22 
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NESS 

36 
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211 
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25 

23 

23 
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colocations , as seen from the tables , corresponds roughly with 
what one would expect from the difference in grid sizes as a 
function of latitude. 

2 . 8.2 Accuracy of Retrievals 

A comparison of Tables 7 and 9 and Figure 18 with Figures 
7 and 8 indicate the GISS and NESS retrievals to be of comparable 
quality near radiosondes, the GISS retrievals being slightly 
worse in the summer and better in the winter. Table 17 gives 
the latitudinal breakdown of total profile RMS errors of GISS 
aad NESS retrievals over water vs. radiosonde colocated to +3 
hours for both the DST 5 and DST 6 period. In general, the 
latitudinal breakdown is fairly homogeneous. The summer retrievals 
are roughly comparable overall, with the exception of the zone 
50°/40°N, where, in fact, the lower tropospheric retrievals 
are comparable to elsewhere, but upper tropospheric and stratospheric 
temperatures are poor. The GISS winter retrievals are significantly 
better in all zones from 18 “N - 70®N. The loss of the 15 ym channels 
appears to have degraded the quality of NESS retrievals more than 
the GISS retrievals, 

2 . 8.3 Dependence of Retrievals on the Initial Guess 

The potential impact of assimilating satellite retrievals into 
a forecast model is maximized if the satellite temperature errors 
and forecast temperature errors are uncorrelated to each other. 

Tables 7 and 9 include the correlations of errors of retrievals vs . 
both forecast and climatology guess errors. While we have demonstrated 
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Table 17. zonal Accuracies of GISS and NESS Retrievals 

DST-5: August 18 - September 1 
DST-6: January 29 - February 12 
+3 Hours, 110 Km, Water 



Method 
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NESS 
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2.39 

2.36 

2.20 

2.02 

1.99 

2.52 

2.90 

2.39 

1.75 

0 

DST-6 

GISS 

2.38 

2.71 

2.58 

2.72 

2.55 

2.13 

1.91 

2.30 
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2.51 

3.08 


NESS 

3.01 

3.06 

3.01 

2.94 

2.85 

1.88 


2.84 

3.01 

2.44 



that the retrieved temperatures from 500 mb to the surface are 
fairly guess independent, the correlation of retrieval errors to 
forecast errors appears to be moderate, roughly .5. This is in 
fact an example of "spurious correlation" arising because correla- 
tions are being made of two quantities with a common quantity (the 
radiosonde temperature) subtracted from them. 

Table 18 gives the correlation coefficients vs. height of 
GISS retrieval errors vs. GISS forecast errors and NESS retrieval 
errors vs. GISS forecast errors. The NESS retrievals ought to be 
completely uncorrelated with the GISS forecast because th«i GISS 
forecast in no way entered into the calculation of NESS temperature 
profiles. The correlations are in fact .3-. 4 on the whole. The 
GISS retrievals are only slightly more correlated from 500 mb to 
1000 mb. This indicates that the errors are to a good extent un- 
correlated with the forecast guess. The region from 300 mb to 200 
mb, on the other hand, is highly correlated, as discussed previously, 
because the soundings contain less detailed information in this 
region. 

2.9 CONCLUSIONS 

This chapter has shown that an alternate scheme for proces- 
sing HIRS/SCAMS data to retrieve temperature profiles has been 
developed at GISS, which is fundamentally different from the ap- 
proach used to create the operational NIMBUS 6 DST temperatures 
developed at NOAA/NESS, in that unlike the operational approach, 
the GISS approach makes no use of a priori statistics . 
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Use of statistics tends to bias the solution towards the 
expected, with a decrease in probability of finding less common 
meteorological situations. The GI,SS approach, on the other hand, 
is not biased towards the expected , but does p,ut a great emphasis 
on the ability to theoretically reproduce and account for the at- 
mospheric and surface physics. Systematic errors in retrieved 
temperatures will occur in situations where the physics is not 
adequately accounted for. Therefore the retrieved temperature fields 
should have greater variability than with a statistical approach, 
though some of it may be spurious . Techniques are presently being 
developed to distinguish the spurious from the read, (or at least 
realistic) meteorological situation. 

Specific findings in the chapter are summarized below: 

•GISS HIRS alone and SCAMS alone retrievals are of comparable 
quality in the summer DST 5 period. A combination HIRS/SCAMS 
retrieval system gives a significant improvement in the lower- 
tropospheric results . 

•HIRS alone retrievals are impossible during the vdnter DST 6 
period because of loss of the 15 pm channels. GISS HIRS/SCAMS 
retrievals are slightly better than SCAMS alone. Most informa- 
tion in the HIRS/SCAMS sounder comes from SCAMS. 

•GISS temperature retrievals in the lower troposphere are 
essentially independent of the initial guess. They should 
therefore be of comparable quality in data sparse regions as 


near radiosondes, The RMS errors over the lowest 500 mb, 
using a climatology guess, are 2,2« for the summer and 2.6» 
for the winter. Part of this increase is due to the greater 
, spatial and temporal variability of temperatures in the 

winter; part is due to loss of the 15 ym channels. 

c 

•GISS retrievals in the Arctic for both summer and winter 
periods are of comparable quality to those elsewhere. 

•The yield of GISS retrievals is about 85% of all satellite 
colocations for both winter and summer. The number of 

retrievals per day is slightly less than NESS due primarily 
to a larger grid size. 

•The accuracies of GISS and NESS retrievals are comparable 
in summer. GISS retrievals appear to be better in winter. 

•Cloud heights determined by qiss retrievals by two sets of 
measurements differ on the whdls by between 0>50 mb. This 

indicates the accuracy of cloud height determination to be 
about 25 mb. 

2,9.1 Expectations for FGGE 

The temperature sounding system on TIROS-N to be used in FGGE 
IS basically similar to that on NIMBUS 6. SCAMS is to be replaced 
by MSU, which is basically similar but contains an additional strato- 
spheric sounding channel and slightly lower noise levels. HIRS is 
to be replaced by TSU, again basically similar, but with substantially 
improved noise levels and a very important correction in that both 


the 15 ym and the 4,3 ym channels will be seeing the same field 
of view at the same time. • Slight differences in the fields of view 
of the two sets of channels on the HIRS, coupled with relatively 
high noise levels, seriously degraded the cloud filtering ability 
and general overall quality of the HIRS retrievals . These contribu- 
ted to the relatively large (2.7®) surface temperature RMS errors. 

TSU will also have an additional 3.7 ym window channel, thus al- 
lowing one to retrieve ground temperature independent of surface 
(air) temperature during the day. On HIRS, retrievals over land 
during the day, especially arid land, could not be done because of 
large differences in ground and surface temperatures. 

These changes should, make significant improvement in the quality 
of TIROS-N temperatures over NIMBUS 6, perhaps of the order of a few 
tenths of a degree at the surface. The limiting factor in the accuracy 
of the retrieved temperatures will still be the lack of sufficient 
vertical resolution to measure significant meteorological features. 

The sounders on TIROS-N will be no better in this regard than those 
on NIMBUS 6. 
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"'able lA. Missing NIMBUS DST-6 Temperature Data by Date/Time 


LENGTH GH GflPCHCJRSJ 

TAU 

C4TE 

TIME 


6.3C 

26555.24 

76/ 

1/51 

2.14.17 



£6544 .54 

ItJ 

1/31 

8:.52.20 


1 .9S 

26547.58 

76/ 

1/31 

11. 58.35 



26549,67 

76/ 

1/31 

i3.ee. 7 


1.75 

26551 .15 

76/ 

2/ 2 

7. 8.54 



26552.54 

7 6/ 

2/ 2 

8.56.15 


1.65 

26558 .1 1 

7 6/ 

2/ 2 

14. 6.33 



266CC.CC 

76/ 

2/ 2 

15.55.45 


C. S£ 

266 11 .7 1 

76/ 

2/ 3 

3.42.25 



26612.65 

It/ 

2/ 3 

4.41.15 


0.5 5 

26551 .76 

76/ 

2/ 4 

15.45.28 



26652.31 

76/ 

2/ 4 

20.18.30 


1.45 

26677.07 

76/ 

2/ 5 

21. 3.59 



26678 .56 

76/ 

2/ 5 

22.33.30 


1.55 

26684 .55 

76/ 

2/ 6 

4.23.12 



26685 .72 

76/ 

2/ 6 

5.43. 7 


7; • 0 ^ 

267C1 .70 

76/ 

2/ 6 

2 1.41 .57 



287C4.75 

76/ 

2/ 7 

0 .44 .45 


2 . a 5 

2r-7C6 . £6 

76/ 

2/ 7 

2. 35.30 

CO 


5 67 Cfi .58 

7 6/ 

2/ 7 

4 . 34 .4 1 

1 . 0 c 

£6725. 5C 

7 6/ 

c / <: 

1.57 .25 

►o O 


26751.66 

76/ 

2/ 8 

3.51 .33 






wg 

5. I 7 

,:f.750 .25 

76/ 

2/ e 

22 • 1.J «.^S 



£;f 753 .4C 

76/ 

2/ 5 

1.23.54 

C.51 

26766 . 05 

1 c/ 

2/10 

12. 2.48 


2676U . 56 

7 6/ 

L/ 1C 

12-57.25 






^53 

0 . e It 

2 ^ ^ *ZL> 

76/ 

2/12 

0. 15.28 



• fc:ii 

76/ 

2/12 

0.52.44 


C . 7 = 

c t A 7 • ^ fi 

76/ 

2/12 

23.55. 17 



26646.74 

76/ 

Ex 15 

0.44.17 


1.5 1 

? t C 4 • 7 tJ 

76/ 

2/ 13 

6*46 *36 



26856.25 

76/ 

2/13 

e. 17.20 




Table lA 


(Concluded) 




IH LI G/*f (Hl.l.*<S) lAU 


r ATf 


T IME 


1 . J'l 

?c->22. 1 2 

76/ 2/lt 

2. 7.44 


2«92J.4 7 

767 2 'lt 

3.26. 7 

1 .t'J 


76/ 2/16 

9.37.44 


ZHZM .n e 

76/ 2/16 

1 1 .26.35 

1 . U 1 

2k<;a 1 ,‘J2 

76/ ?/lt 

? 1 .55 . 4 


-S' A3. 73 

76/ 2/16 

2 3 .^3 .35 

1 . 

2-“.Hl .00 

76/ 2/16 

13.20 .45 


2*<9-3.37 

76/ 2/lh 

15.22. 1 

1 .<.r 

2HS.h6.75 

76/ 2/lb 

IH .44 .45 


2h<;-:h .7 1 

7»>/ 2/ie 

20 .42 .25 

?. 1 

29C16.A 0 

76/ 2/20 

0.23.54 


29C1 6.5c 

75/ 2/20 

2.33.30 

I .»»7 

29C26.Jfi 

76/ 2/20 

10.22 .44 


29C28..75 

75/ 2/20 

12.14 .«5 

1 . 7« 

292 1 6 .26 

76/ 2/2H 

8.16 .38 


292 1 A.OA 

76/ 2/26 

10. 2.20 

0.7i 

29.21 .04 

76/ 2/20 

13 . 2 .20 


29,’2 1 , 76 

76/ 2/2i» 

13.45 .26 

1.9 1 

29.^25 . Of) 

76/ 2/26 

17. 3.30 


29220.97 

76/ 2/2f> 

18.56. 7 

1 . ec 

292 64.6 7 

76/ 3/ 1 

8.40. 4 


29266.55 

76/ 3/ 1 

10.32.46 

1 

29295.02 

76/ 3/ 2 

15 . 1.10 


29 395. CO 

76/ 3/ *J 

16 .56 .51 





7AU 


DATf 


1.34 

2 c a 22. 1 3 

76/ 

2/1 6 


28?23 .4 7 

76? 

2/16 

1 . ci ; 

28‘;20.63 

7b/ 

2/16 


2HC31 .4 6 

76/ 

2/1 e 

1 . a 1 

2H':4i .02 

76/ 

2/1 6 


:-a?43.73 

76/ 

2/16 

1 . a • 

2>'0ai .5 0 

76/ 

2/1 H 


28053 .37 

76/ 

2/lft 

1 . r 

28 086.75 

76/ 

2/ 1 6 


2H 0-:8 .7 1 

76/ 

2/1 e 

2. 1 {. 

2 0 016.40 

76/ 

2/20 


29ClS.5c 

76/ 

2/20 

1.87 

20C26.J8 

76/ 

2/20 


20C2S.25 

76 / 

2/20 

1 . 7f. 

20216.28 

76/ 

2/28 


20213.04 

76/ 

2/28 

0.7 2 

20221 .04 

76/ 

2/2 


2 0 2.21 . 76 

76 / 

2/28 

1.5 1 

20.225. Orj 

76/ 

2/28 


20226 .07 

76/ 

2/28 

1.8c 

20264 .67 

76/ 

3/ 1 


20266.55 

76/ 

3/ 1 

1.8 3 

2 02 05. C 2 

76/ 

3/ 2 


20 206 . >;5 

76/ 

3/ *2 


Luded) 




time 


2. 7.A4 
3.2S. 7 


9 .37 . A4 
1 ! . 2a . 3 5 


?T • £5 « 4 
23.43 .35 


1 3 . 2'3 . 4 5 
15.22. 1 


ia.44 .45 
20 .42 .25 


0.23.54 
2.33 .30 


10.22.44 

12.14 .45 


8.16 .38 

10 . 2 .20 


13. 2.20 
13.45 .28 


17. 3.50 
18.53. 7 


8.40. 4 
10.32 .48 


15 . I . I 0 
16.50 .51 






Table 2A. DST-6 Retrieved Profile Count 
by Date and Bin Number 


OEIGINAL PAGE TB 
OF POOE QUALITY 


( ) 

( ) 

{ snsAS) 
( PdBS'i) 
( C-'jO ) 
( 235o6 ) 
( P857? » 
( 2G576) 
I ) 

( 28590 ) 
( 2«596 ) 
( rJiHOP ) 
( ?.8oOH ) 
( 28614 ) 
2/ .i/75 — 12 (?Ge?.0) 
2/ i/76— la {20626) 

2/ 4/76 — 0 ( ?S6j2) 


2/ 4/76 

6 

< 23636 ) 

2/ 4/7ii — 

12 

( BCe-iA ) 

2/ 4/70 — 

1 a 

{ 28650 ) 

2/ 5/76 — 

0 

< 26G-36 ) 

2/ 5/76 — 

0 

< 28 66 2) 

2/ 5/76— 

1 2 

{ 28663 ) 

2/ 5/70 — 

1 6 

( 28674 ) 

2/ 6/76— 

0 

( 28680 ) 

.2/ 6/76 — 

6 

(26686) 

2/ 6/76 — 

1 2 

( 28692 ) 

3.' 6/76 — 

1 a 

C 28 698 > 

2/ 7/7.0 — 

0 

( 28 704 ) 

2/ 7/76 — 

6 

( 28710 ) 

2/ 7/76 — 

1 2 

( 28716) 

2/ 7/76 — 

1 8 

( 23722) 

2/ a/76 — 

0 

( 28726) 

2/ 3/76 — 

5 

( 2SV34 ) 

2/ 8/76 — 

1 2 

< ?S740 ) 

2/ 3/76 — 

1 6 

C ,'8740) 

2/ 9/7c — 

0 

( -26 752 ) 

2/ 9/77> — 

■ 6 

( 2R758) 

2/ 9/7 6 — 

1 2 

{ 26764 ) 

?/ 9/76 — 

1 H 

( 2H770 ) 

2/1 0/76 — 

0 

( 2M776 ) 

2/1 0/7 6 — 

■ 6 

( 23782 ) 

2/ 10/76— 

12 

( ?a766 ) 

2/10/76 — 

■ 1 a 

« 2 6794 ) 

.2/ 1 1 / 7 6— 

■ 0 

( 26 BOO > 

2/11/76 — 6 

( 26.800 ) 

2/11 /76— 

■12 

{ 2P(! 1 2 ) 

2/1 1 /70-- 

-1 6 

( 23018 ) 

2/ 1 2/76 — 

- 0 

( 26824 ) 

2/ 1 2/76 — 

- 6 

( 28630 ) 

2/12/76— 

-12 

( 28.8 .ib) 

2/12/76 — 

- la 

( 2864 2) 

2/ 1 3/ 7,6- 

- . 0 

{ 2884 0) 

2/ 1 3/76- 

- »■' 

< ?8!>54 ) 

2/1 3/76- 

-12 

( 28.1G0) 

2/ 1 3/76- 

- 1 a 

< 2RR60 ) 

2/1 4/76- 

- 0 

( 2.3R73 ) 

2/1 4/76- 

- 6 

(2 8.3 78) 

2/ 1 4/ 76- 

- 12 

( 2 8 3 6' 4 ) 

2/ 14/76- 

- 1 G 

(28890) 

2/15/76- 

- 0 

( ?8R9t>) 

2/15/70- 

- 6 

( 2 8902 ) 

:vi 5/76- 

- 1 2 

( 28908) 

,J/1 5/76- 

- 1 8 

(26914) 


1/31/76—. 
1/31/75 — 
I/'31/75 — 


0 
6 
1 2 


1/31/76 — I R 


2/ 

2/ 

2 / 

2/ 

2/ 

2 / 

2/ 

2 / 

2 / 

2 / 


I /7 6 — 

J /76 

1/76— 

I /76 — 
2/76 — 
2/7o — 
2/76—12 
2/75 — I e 
.i/76— 0 
3/7 6 5 


0 
6 
1 2 
1 a 
0 
6 


N1 KOOo-M 
N1 MBOf.'!'! 
NI MBC.5-.M 
NI MB06*1 
M y.006* V 
MBBOa*! 
N1 1 

Nt !.',n06*l 
N1 -yrjn6* 1 
N1 MH06« 1 
N1 M006* I 
N1 MB06# 1 
N1 f/BCG* 1 
M M006« 1 
NI ^•r3C•(>«' 1 
M MO. 06* I 
NI VBQ5*i 
N'l yH06*l 
M M-iOe* 1 
N1MB06*1 
MMH06*1 
NI y 006*1 
MK06* 1 
;ni i;ti 06 *i 
N I MHO 6 1 
NI MB06* 1 
NI Ma06*l 
M MB 06*1 
NI i.0i06*l 
M m 006*1 
NI M506*l 
N I .Mb 0.5 * 1 
NI Mb 06*1 

NI Mno6«r 

Ml-lfiOo*! 
NI Mb 06*1 
NI MtiO'jwl. 
NI MH06*1 
NI MB 06* I 
NI Mc)0 6* l 

M MHO 6*1 
N ! .Mb 05* 1 
NI MbOo*! 
M MP.06*1 
NlMa06*»l 
MMty06*l 
NI KH06*1 
N I MB06* 1 
NI MU06*1 
NIMH 06*1 
NI Mt>C6* 1 
N1M1306*! 
M VU05*1 
N 1 MH06*1 
M 4Mrt06*l 

M .MUne *! 
NI NO 06*1 
M MB0 6* 1 
NI MrO-6*l 
N! M-.-lG *! 
NI Mn06*i 
M MB 06 *1 
NI Ml!05*1 
NI NB06* 1 


1070 STATIONS — 
166 STATIONS — 

1016 STATIONS 

1541 STATIONS — 
1227 STATIONS — 

1452 STATIONS 

1513 stations 

1563 STATIONS 

1382 STATIONS 

1141 STATIONS — 

13 7S STATl-ONS 

1316 STATIONS 

1221 STATIONS 

1252 STATIONS — 
16 13 STATIONS— 

14 15 STATIONS^ — 

1036 STATIONS 

1582 STATIONS — 
1410 STATIONS — 

1497 STATIONS 

1226 STATIONS — 

1616 STATIONS 

14R9 STATIONS 

1541 STATIONS 

1038 STATIONS 

1098 STATIONS 

1465 STATIONS — ■ 
1545 STATIONS 

524 STATIONS — 
1157 stations — 

1522 STATIO.NS — 

1594 STATIONS 

1337 STATIONS — 

1226 STAriONS 

1532 STATIONS 

I486 STATIONS 

661 STATIONS 

1539 STATIONS — 

1506 STATIONS 

155S STATIONS 

1532 STATIONS 

I32d STATIONS 

1624 STATIONS — 
1536 STATfONS — 
1517 stations 

1507 STATIONS — 

1523 STATIONS — 

1544 STATIONS 

1540 STATIONS — 

1522 STATIONS 

1495 STATIONS 

1553 STATIONS — 

1347 STATIONS 

1215 STAT1CNS-- 
1534 STATIONS — 
1422 STATIONS — 
1193 STATIONS — 
1145 STATIONS — 
12C2 STATIONS — 

1568 stations 

1377 STAT1UNS-- 

1495 6TAT I ONS 

1469 STATIONS 

1566 STATIONS 


250366 BYTBS 
38550 BYTtS 
226214 BYTES 
357550 BYTES 
284702 BYTES 
330902 BYTES 
351054 BYTES 
362654 BYTES 
320662 BYTES 
264750 BYTES 
319966 BYTES 
305814 BYTES 
283310 BYTES 
290502 BYTES 
374254 BYTES 
32S318 BYTES 
240390 BYTES 
367062 BYTES 
327158 BYTES 
347342 BYTES 
204470 BYTES 
374950 • BYTES 
345486 BYTES 
357550 BYTES 
240854 BYTES 
254774 BYTES 
339918 BYTES 
35.5478 BYIES 
121606 BYTES 
268.462 BYTES 
333142 BYTES 
3G9W46 BYTE.S 
3 1022.2 BYTES 
2.84470 BYTES 
355462 BYTES 
344790 BYTES 
153390 BYTES 
357086 HYTES 
349430 BYTES 
361726 BYTES 
355462 BYTES 
308134 BYTES 
376R06 BYTES 
300390 BYTES 
3‘6l9f52 BYTES 
349662 BYTES 
353374’ BYTES 
35824c BYTES 
.35 7318 BYTES 
353142 BYTES 
34087U BYTES 
360334 BYTES 
31254.? BYTES 
281918 BYTES 
255926 BYTES 
329942 BYTES 
276614 BYTES 
205678 BYTES 
27890.2 BYTES 
363614 BYTES 
319502 BYTES 
246078 BYTES 
345466 BYTES 
36.18 14 BYTES 
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Table 2A. (Concluded) 


‘?/i(y/7Fi- 
Z/ 1 6/ 7h ■ 

?/16/76- 
2/1 V/7(>- 
2/1 7/76- 
2/17/70- 
2/1 7/76- 
2/10/76- 
2/1 0/76- 
2/1 K/76- 
2/1 U/76- 
2/ 1 9/ 76- 
2/1 9/76- 
2/ 1 9/76- 
2/19/76- 
2/20/70- 
2/20/76- 
'2/20/76- 
2/2 0 /^ 6 - 
2/21/76- 
2/21/76- 
2/2 1/76- 
2/2 1/76- 
2/22/76- 
2/22/76- 
2/22/76- 
2/22/76- 
2/2 J/76- 
2./2,j/75- 
2/22/76- 
2/20/76- 
2/2<(/76- 
2/24/76- 
2/24/76- 
2/24/76- 
2/25/76- 
2/25/76- 
2/25/76- 
2/25/76- 
2/2 6/76 — 
2/2 6/76 — 
2/2 6/76 — 
2/2 6/76-- 
2/2 7/76 — 
2/27/76 — 
2/2 7/76 — 
2/27/76 — 
2/20/76 — 
2/2 0/76 — 
2/20/76 -- 
2/20/76 — 
2/29/76 — 
2/29/76 — 
2/29/76-- 
2/29/76 — 
3/ 1/76 — 
3/ 1/76 — 
3/ 1/76 — 
3/ 1/76 — 
3/ 2/76 — 
3/ 2/76 — 
3/ 2/76 — 
3/ 2/76 — 
3/ 3/76-- 
3/ 3/76 — 
3/ 3/76-- 
3/ 3/76 — 
3/ 4/76 — 
3/ 4/76 — 
3/ 4/76 — 
3/ 4/76 — 
3/ 5/76 — 


i — .0 ( 2a<3?9 ) 
> — 6 (2P926) 
i 12 (209 32) 

> 10 ( 209 3(1) 

> 0 (20944) 

> — 6 (20950) 
' — 12 (3S956) 

> — 10 (2 « > .J 6 2 ) 

■ — 0 (20966) 

' — 6 { 2 097', ) 
— 12 (26980 ) 

' 1 0 (20906) 

— 0 { 20992) 

— 6 (2099.-.t) 

— 12 (29004) 
— -16 (29010) 

— Cl ( 29016) 

— 6 ( £9022) 

— 12 ( 29023) 

— 10 ( 29034) 

-- 0 (£9040) 

— 6 (29046) 

— 12 (£905 2) 

— 16 ( 29C 58 ) 
-- 0 (25064) 

— 6 (29070) 

— 12 (250 76) 
— 16 (25C82) 

— 0 (25083) 

- 6 (25054) 

-12 (251C0) 
-16 (25106) 

- 0 (£5112) 

- 6 ('5118) 

- 12 ( £5124) 

- 1 6 ( 25 1 30 ) 

- 0 (29136) 

- 6 (£5142) 

-12 (25140) 
-16 (25154) 

- 0 (25160) 

- 6 (.£51c&) 
-12 (£91/2) 
-IS (25178) 

- 0 ( 2 5 1 K 4 ) 

- 6 ( 25190 ) 

-12 (29156) 
-16 (£5202) 

-. C { 2^206) 

- 6 (25214) 
-12 (29220) 
-13 (25226) 

- 0 { £523? > 

- e (25238) 
-12 (25244) 
“13 (25250) 

- 0 ( 25256 ) 

- 6 ( 252C2 ) 
-12 (£5268) 
-16 (25274) 

- 0 (25260) 

- 6 { 25286 ) 
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CHAPTER III 


3. ANALYSIS AND ASSIfULATION 

(M. Ghil, Scientist; R. Dilling, Manager) 

ORIGINAL PAGE IS 
OF POOR QUALITY 

3.1. INTRODUCTION 

To achieve the goal of improved 2 to 5 day numerical weather 
forecasts we need a better knowledge of the state of the atmosphere 
at the beginning of the forecast — the initial state . During the 
1976 Impact Test Project the main thrust of the work done by the 
Analysis and Assimilation iGroup at GISS was the attempt to optimize 
the use of satellite-derived temperature data in the approximation 
of initial states. 

The GISS approach to satellite-data utilization has been that 
of assimilating the data continuously into a model integration 
running from 48 hours before initial forecast time and up to the 
initial time (Jastrow and Halem, 1973). -In the past, the assimilation 
was done by direct insertion (Bengtsson, 1975, p. 24) of the data at 
adjacent model grid points. It seemed desirable to try to improve 
upon this procedure by other techniques that take into accoiant observed 
data, as well as forecast values, according to certain meteorological 
criteria of dynamical and statistical nature. 

The Analysis and Assi'milation Group set out for the Impact 
Test Project to develop, test and evaluate a number of techniques 
and apply the more successful ones to DST-5 (Aug. -Sept. 1975) and 
DST-6 (Jan. -March 1976) data. The techniques considered were: 

(a) different variants and improvements of the GISS direct in- 
sertion analysis and assimilation scheme, (b) variational methods. 
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(c) utilization of a filteret? 

. _equations moael for initialization 

and assimilation purposes, and (d) statistical assimilation . 

methods. 

The basic assimilation procedure in all the tests reported 
herein was essentially time-continuous, four-dimensional assimila- 
tion of satellite-derived temperature data into a 48-hour model 
integration. For instance, in order to obtain the initial state 
at 008 February 1 , 1,76, an integration, or run, of the current 
GISS model (see chapter 4= Forecast Model Development) wad started 
at 008 January 30, from a conventional obiective analysfs. Then 
forecast values were modified talcing into account the additional 
information obtained from satellites during the 48 hours till 
xnitial forecast time on February 1 . 

Modifications of grid point values of meteorological 
variables were made at every model time step during the asslmilatio, 
run. The modifications were based on the satellite-derived tempera- 
ture values obtained during the time step in question. The al- 
gorithm Which yields modiHed values of grid variables by using 
Observed temperature values constitutes the specific assimilation 
technique. The methods and techniques we studied are 

in different stages of development and assessment at the writing 
Of this Report. 

In the area of changes and improvements in Insertion 
-thods previously used at GISS , progress has been made in two 
directions: ,1, development, testing and application of a successive 
£2£rectionjgthod to the analysis of conventional synoptic data, 
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as well as to the assimilation of satellite-derived temperature data, 
and (2) development, testing, and evaluation of an automated con - 
sistency check of synoptic and asynoptic data. 

The development and testing of a variational method are in 
progress. The method attempts to minimize in a root-mean-square 
sense the difference between the meteorological variable values 
inserted into the model and the observed values of these variables, 
while at the same time forcing the inserted values to satisfy cer- 
tain smoothness and compatibility constraints derived from model 
dynamics. The method concentrates on asynoptic data and uses a 
direct minimization technique. 

i 

A partial evaluation of the GISS Filtered Equations Model 
(FEM) for initialization and assimilation purposes resulted in the 
assignment of a low priority to the continuation of this effort, 
and work on this approach has been discontinued. 

The statistical methods were easiest to develop within the 
short time span of the Impact Test Project and proved particularly 
successful in obtaining consistent forecast improvements from the 
use of sounding temperatures. This is the first time that such methods 
have been applied to a truly four-dimensional assimilation procedure 
using large sets of real data, and we believe that the modest-, but 
statistically significant success of our impact tests is due to a 
large extent to this assimilation method. 
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3.2 METHODS 

r/ 

3.2.1 Direct Insertion Method (DIM) (R. oiiiing and m. chii) 

3. 2. 1.1 Introduction 


A direct insertion method of four-dimensional data assimila- 
tion has been used at GISS for a number of years. The method used 
for conventional synoptic dc'ita was described by Russell (1975) . 
Asynoptic data, such as temperature profiles derived from given 
satellite-measured radiances were first inserted directly into the 
model: indeed, these profiles were obtained in the past by GISS 

processing methods at GISS model grid points in the horizontal, 
and at model sigma levels in the vertical. More recently, 
temperature profiles derived by different methods at NESS from 
satellite radiances have been inserted at each model time step 
using an adaptation of the direct insertion method. This adaptation 
was also described by Russell (1975) . 


The purpose of this section is to briefly describe the direct 
insertion method, the quality control of insertion data, and the 
results of the method for two winter experiments. The quality 
control methods described here should be compared with the automated 
consistency check (ACC) described in Subsection 3.2,2. The DIM 
experiment results are to be compared with the results of experiments 
using the successive correction method (SCM, Subsection 3.2.4) and the 
statistical assimilation method (SAM, Subsection 3.2.7). Such a com- 
parison appears in Subsection 3.3.2. 

3. 2. 1.2 Quality Control of Insertion Data 

The two numerical experiments we discuss used different 
controls for satellite data. In this section we define 


the rejection criteria used for both conventional and satellite 
data. The basic idea of the quality controls here is to eliminate 
totally erroneous observations by comparing them with model forecast 
values; the latter have the advantage of always being "reasonable," 
even when not entirely correct. 


The comparison between model forecast values and observed 
data is made at observation points. Thus, model data are first 
inerpolated vertically to the mandatory pressure levels and then 
horizontally to the latitude and longitude of the observation. 
For each variable Q, the acceptance test is 


i ■'Q ' 

where Lq is the ma.xiraum acceptable absolute difference for quantity 
Q at mandatory pressure level k. The quantities subject to 
quality checks are the horizontal velocity components u,v, the 
temperature T, the relative humidity q, and the surface pressure p^. 

standard rejection criteria used for synoptic and asynoptic data 
are given in Table 1 . 

Table 1 

Ic 

standard Rejection Criteria 


Quantity 

Synoptic 

Asynop 

^(k-^1,11) 



u 

30 m/sec 

n.a. 

V 

30 m/sec 

n.a. 

T 

7°C 

7°C 

q 

0.25 

n.a. 


20 mb 


n.a. 





For asynoptic satellite-derived temperature profiles a special 
set of rejection criteria have been defined and used in one of the 
two numerical experiments we describe. This set consists of the 
following tests, all of which must be satisfied for the temperature 
data at a given location and level to be inserted: 
a. The "weighted profile RMS error" must not exceed 5°C. This 
weighted RMS error is defined as 


k 




(T^ -T^ \ 2 

' fcst. ^sat,^ 


k 


1 


here the sums are over mandatory pressure levels and the weights 
are given in Table 2. If this criterion is not satisfied, all 
the temperature data at that location, l<k<ll, are discarded. 


Table 2 

Special Satellite-Temperature Rejection Criteria 

T 


k 

Pressure 

level 

Lt 

1 

1000 mb 

3°C 

2 

850 

3.5°C 

3 

700 

4°C 

4 

500 

4.5°C 

5 

400 

5°C 

6 

300 

5.5°C 

7 

250 

6“C 

8 

200 

6.5‘’C 

9 

150 

7°C 

10 

100 

7.5°C 

i 

11 ' 

70 1 
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00 




b. If test a. is satisfied then each level k is individually 
tested for acceptance: 



k 

fcst . 



< 



c. Finally, if the time of the satellite observation from which 
the temperature is derived is within 6 hours after synoptic 
time (OOZ or 12Z) , then a weight factor F is used: 


F (t) =1, 6£t<12, 
F (t) = p 0£t<6 ; 


j^ 0 .^e X is the difference expressed in hours between the txme 
of the satellite observation and the closest preceding synoptic 
time. The difference between the satellite-derived value and the 
model value is multiplied by the factor F, and it is this modified 
correction which is added to the model value; this factor 
reflects in a crude way the relative confidence in forecast 
and observation as time elapses from synoptic analysis time. 


3. 2. 1.3 Description of DIM Experiments 

The two DIM experiments we discuss in this section are 
denoted by numbers 8186 and 8240. Each numerical experiment 
assimilated conventional synoptic data using a 12 — hour cycle 
beginning OOZ, Jan. 29, 1976 and ending 03Z Feb. 21, 1976. 

In experiment 8240 only NESS— processed NIMBUS temperature data 
v^ere inserted, whereas in 8186 NESS“processed VTPR, as well as 
NIMBUS temperature data, were inserted. The quality controls for 8186 
were the standard rejection criteria for both synoptic and asynoptic 
data. For 8240 the standard rejection critef'ia were used for 
conventional data, and the special rejection criteria were used 
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for the satellite data. The forecast model used in the 
four-dimensional assimilations was the current standard 4° by 5“ 
GISS GCM (see Chapter 4) . A geos trophic correction based on 
derived temperature data was made to the winds near 
temperature insertion points (cf. Stone et al . , 1973; see also 
Kistler and McPherson, 1975) . The impact tests consisted of 
studying 11 forecasts from 03Z February n, where n = 1,3,5,7...11. 
Each forecast from an initial state obtained by four— dimensional 
assimilation of satellite data was compared with a forecast from 
a control initial state at the same time; the control, or NOSAT , 
initial state obtains by a four-dim.ensional assimilation in which 
no satellite data are actually inserted. 


Table 3 

Experiment 8136 

Average Impact over North America 




48 hour 

72 hour 


RMS 

Skill Score 

RMS 

Skill Score 

SLP 

.21+. 40 

-1.55+1.86 

~.48+.27 

-3.96+2.16 

Z500 

.43+3.54 

-1.42+1.28 

-3.34+2.96 

-.69+1.19 


Table 4 

Experiment 8240 

Average Impact over North America 



48 hour 

72 hour 


RMS 

Skill Score 

RMS 

Skill Score 

SLP 

.25+. 18 
“ 

.06+1.12 

.27±.32 

.76+1.90 

Z500 

2.46±l.?/7 

.25+. 79 

-.41+3.41 

-.52+89 


3.2. 1.4 Results OF DIM Experiments 

RMS errors and SI skill scores of sea-level pressures (SLP) and 
of 500 nOa geopotential heights (Z500) were calculated at 48 and 72 
hours after initial time for each forecast, based on the difference 
between forecast values and the corresponding values provided by the 
NMC analysis at the same synoptic times. These error measures were 
computed for both the control forecasts which were started from NO 
SAT initial states, and the experimental forecasts 8186 and 8240. 

Tables 3 through 6 summarize the impact results for the 11 indi- 
vidual forecasts. Differences d^, l£i£ll, between the error measures 
(RMS or SI) for the experimental forecasts and the corresponding 
error measure for the NO SAT forecast with the same initial time 
were computed^ The entries in the tables are the average d, d = 
sj^^di/ll, and the standard deviation o,o^ = (d^-d) ^/ll, of RMS 

error differences, and of the SI skill-score differences over the 
11 cases, respectively. They are given in the form d+a. We consider 
a result statistically significant if d>>a. Results for verification 
over North America (30°N to 70“N and 75°W to 130®W) are given in 
Tables 3 and 4 for run 8186 and run 8240, respectively. Similar 
results for verification over Europe (30®N to 86®N and 10“W to 40“E) 
are given in Tables 5 and 6. 

—'Vi 

A statistically significant (d==2a) positive impact occurs for 
experiment 8186 in the Si score of the 72-hour sea-level pressure 
over Europe (Table 5), and marginal (d= 0 ) positive impapt obtains 
for the 48-hour skill of sea-level pressure over Europe; even these 
impacts are not consistent with the results for RMS errors or for the 
the 500-mb heights. A marginally significant (d=o) positive impact 
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occurs also in the RMS error of the 500-inb heights at 48 hours over 
Europe in both experiments (Tables 5 and 6) . All other impacts 

are negative and/or statistically insignificant. 


Table 5 

Experiment 8186 
Average Impact over Europe 




18 hour 

72 hour 


RMS 

Skill Score 

RMS 

Skill Score 

SLP 

0.38±.32 

— 

1.65±1.31 

0.15+.43 

2.31+1.37 

Z500 

3.5+3.23 

1.36±1.69 

0+3.17 

-1.46+1.48 

— 


Table 6 

Experiment 8240 
Average Impact over Europe 



48 hour 

^ 1 

72 hour 


RMS 

Skill Score 

RMS 

Skill Score 

SLP 

.25+. 19 

.28+. 53 

.39+. 23 

.6611.21 

Z500 

1.46+2.35 

.19+. 98 

— _ — i 

1.40±2.68 

-.39+. 95 

L ■ 


The results for experiment 8240 are also summarized in 
Subsection 3.3.2. 3. 

3. 2, 1,5 Conclusion 

we see that assimilation of DST-6 asynoptic data by the Direct 
Insertion Method failed to exhibit a positive statistically 
Significant impact of the satellite observations. This method has 
been presented primarily for comparison with the results of the new 

techniques developed and tested by the Analysis and Assimilation 
Group. 




3,2.2 Automated Consistency Check (ACC) (k,k. wong, p. suchanick, 

and M. Ghil) 

3. 2. 2.1 Introduction 

One of the problems encountered in assimilating observational 
data into numerical forecasting models is that of determining whether 
the data inserted are of a reliable nature (e.g., Gandin, 1963, pp. 
158-166), The method previously used at GISS was to compare the 
observed value with the model forecast values at adjacent grid 
points and reject the data if the difference exceeded a Specified 
value. 

The above procedure is described in Subsection 3. 2. 1.2 
and referred to throughout the rest of this report as quality 
control ; it had the considerable advantage of being very easy to 
implement. Its drawback is that it only allows for the use of 
very large error tolerances, and thus rejects only observations 
which had highly unreasonable values. It does not use the error 
structure of the data themselves and would in fact reject useful data 
when the forecast model happened to differ considerably from the 
actual state of the atmosphere. To eliminate the obvious short- 
comings of this type of method, a procedure was developed that 
uses as rejection criterion a comparison of a given observation 
with the observations surrounding it. 

3. 2. 2. 2 Procedure 

Since in most cases the data are not received in a strict 
geographical order, the first step in the procedure is to order 
the data according to latitude and longitude. Surface quantities. 


pressure and temperature, are reduced to sea level. 


For each observation point all the observations within a 
given radius are then stored and sorted according to distance 
from the selected observation point. Next, the sorted data 
points are scanned according to increasing distance, until three 

points are found which form a triangle having the observation in 
question in its interior. 


The quantities at the three points forming the triangle 
are then linearly interpolated to the interior observation point, 
and the difference between the interpolated value and the observa- 
tion IS calculated. Histograms of the computed differences are 
shown in Figures 1 to 3. If a triangle cannot be formed about a 
selected observation, or if the observation is missing', or if it 
is obviously in error, it will be ignored in- further computations. 

The standard deviation a of the difference for all observa- 
tions IS computed and it serves as the basis for the rejection 
criterion. The computed values of a for the different quantities 
are as given in the first row of entries in Table 7. If the 
difference between an observation and the interpolated value of 
Its three selected neighbors is less than 2a the observation is 
considered reliable and is used in the assimilation without 
further modification, if the difference lies between 2a and 3a, 
it is assumed that the observation is partially correct; the 
observed value is then modified to a value equal tp the interpolated 
one plus or minus 2 a, depending on whether it exceeds 2a in the 
positive or negative direction. Finally, if ^he difference is 

g ater than 3a, the observation is considered to be in error and 
will be rejected. 
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Figure 1. Hisiogram of the distribution of differences between the observed values 
of sea-level pressure, pg, at a given point, and the values obtained by linear inter- 
polation from observed values at the 3 observation points which are the nearest neighbors 
of the point under consideration; }i=0.006 mb, 0=4.689 mb. 
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Figure 2. Same as Fig. 
U=-0.094°C, 0=6.688°C. 


Notlcft^fr to % (sea-level temperature) ; 

Notice that u/a again does not differ significantly from zer 
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Figs. 1 and 2: histogram corresponding to the temperature Tx=T(pa) , 
at the mandatory pressure level P4=500 mb; u=-0.076®C, o=2.335°C. Notice that^cf here 

is considerably smaller than for T - 


3. 2. 2. 3 Results 


A test analysis was performed on surface pressure, surface 
temperature and upper air temperature at mandatory levels. The 
test compares the number of observations accepted and rejected 
using the above criteria with the corresponding quantities when 
using "quality control", i.e., the differences between the model fore- 
cast value and the observation. The rejection criteria currently 
used in quality control are 20 nib for surface pressure and 7°C for 
surface and upper air temperatures. Results of this comparison are 
shown in Table 7. The three categories in Table 7 refer to the 
observations accepted, modified, or rejected by the ACC criteria. 

The subdivisions labeled "accepted" and "rejected" refer to the number 
accepted or rejected by the quality control procedure based on the 
difference between forecast and observational values. 

Table 7 


*7 Value 
A 


T 

S 

850 

700 

Temperature 
500 400 

: at 
300 

Mandatory Levels 
250 200 150 

1 (mb) 
100 

70 

4.7 

6.7 

3.8 

3.5 

2.3 

3.4 

3.6 

5.8 

3.3 

3.5 

2.4 

3.3 

C accepted 

3199 

3067 

259 

376 

396 

382 

375 

293 

268 

255 

204 

230 

P rejected 
M 

1 

207 

5 

1 

0 

0 

5 

20 

13 

28 

48 

3 

0 accepted 

90 

131 

3 

8 

13 

6 

7 

6 

7 

4 

6 

6 

D rejected 

R 

0 

29 

0 

1 

1 

0 

1 

9 

8 

1 

2 

1 

E accepted 

166 

218 

19 

11 

9 

9 

8 

6 

7 

7 

0 

11 

J rejected 

18 

73 

6 

7 

0 

1 

1 

5 

1 

2 

1 

3 
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In genercvi, it can be seen that a significant difference 
between the two methods appears in the numbers for surface pressure 
and temperature. A significant number of surface temperature 
observations (207), which under "quality control" would have been 
rejected, are accepted under ACC. Conversely, -a sizeable number of 
surface pressure and temperature quantities that were accepted 
under quality control standards are either modified or rejected 
with ACC. Another significant difference’ appears in the .250- to 
70-mb temperature observations where a large number of observations 
are rejected by quality control and are acceptable under ACC. 

This is probably due to the inaccurate representation of the 
temperature inversions in the tropopause ' region by the forecast 
model. 

3. 2. 2. 4 Conclusions And Recommendations 

An inherent drawback in this procedure is accounting for 
observations in data-sparse regions. With conventional synoptic 
data, a significant number of reports cannot, be evaluated with 

this procedure; "quality control" procedures have to be used for 
such observations. 

The ACC method is currently being modified to apply to 
asynoptic satellite data. Considerable improvement over present 
quality control procedures is expected in this application, where 
no data sparsity problem exists. For asynoptic data, ACC can 
be combined with the local interpolation procedure (LIP, 

Subsection 3.2.3) to provide a simple, effective filter of 
.observational errors. 

Assimilation runs remain to be made and results analyzed 

to test the effect of synoptic and asynoptic data verified by the 
ACC method on forecast accuracy. 
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3.2.3 Local Interpolation Procedure (LIP) («• carus. m. ohii, and 

R. Dilling) 

3. 2. 3.1 Introduction 

Satellite-derived temperature data, as well as conventional 
synoptic data, are obtained in general at locations that do not 
coincide with grid points of a computational grid. Values of the 
observed fields at grid points have therefore to be computed f.rom 
the values at the observation points. Subsections 3.2.1 (DIM) 
and 3.2.4 (SCM) describe two simple procedures for such a computation. 

in addition to the problem of the difference in location, 
we also have to deal with the fact that the observations contain 
measurement errors, and also errors because of the difference 
between the length scale of which a measurement is representative 
and the scale of the model's grid size. A certain filtering 
of these observational errors is contained in each of the methods 
presented in Subsections 3.2.2 (ACC), 3.2.4 (SCM), 3.2.5 (AVM) and 
3.2.7 (SAM). The method we present here obtains values of the 
observed fields at grid points and also contributes to filtering 
out the errors. It has been developed mainly as a preliminary 
data handling procedure for the statistical assimilation method 

(SAM) . 

3. 2. 3. 2 The Method 

The method is based on least-square-fitting of low-degree 
polynomials to the data. The value of the fitted polynomial at a 
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grid point in the vicinity of observations is accepted as the 
value of the pre-filtered observed field at that point. The 
filtering obtains because of the least-square fit. The poly- 
nomials depend on a number of parameters which is smaller than the 
number of observations; the parameters are simply the coefficients of 
the polynomial. Thvis we can place higher confidence, in a statistical 
sense, on the values of the coefficients than on the individual observ“a- 
tions. Purthermore, low-degree polynomials are considerably smoother 
than a high-degree interpolation polynomial which would ahtually pass 
thorough all the observations. A good rule of thumb for least-square 
polynomial fitting is that the number of coefficients should be com- 
parable to the square-root of the number of observations fitted {cf. 

Isaacson and Keller, 1966). 

In its present form, the method has been formulated for 
satellite-derived temperature data obtained in 10-minute time in- 
tervals, (compare Subsection 3. 2. 7. 2). Such an interval is suf- 
ficiently small so that time itself need not be considered as a 
variable, and the data are assumed to be simultaneous. We found 
in general that a sufficiently large number of temperature 
retrievals obtain within an interval so as to expect a large 
part of the noise to be filtered out by the least-square fit of 
polynomials up to the third degree. The independent variables in our 
polynomials are latitude vf) and longitude X. The fit occurs on fixed 
mandatory pressure levels, so that no vertical variable is necessary. 

We regard a gridpoint as lying in, the vicinity of an observa- 
tion point, or retrieval, if it is a corner of a grid rectangle con- 
taining one or more retrievals. Such a restriction is required 
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to avoid using the fitted polynomial in an extrapolatory mode. 

The value of the observed temperature field at a grid point, or 
^pothetical retrieval at the gridpoint, is assigned the time of 
the earliest retrieval in any of the four grid rectangles sur- 
rounc.xng the gridpoint; the assignment of time is necessary since 

^ ll 

the .hypothetical retrievals are computed "off-line", before 
their use for assimilation purposes. The hypothetical retrievals 
at grid points become observed temperatures for an assimilation run, 
replacing the raw observations at their off-grid locations. 

Ij 

Since the data are provided and fitted in discontinuous 
patches, the question of the continuity of the prefiltered observa- 
tion field arises. This question was confronted in an ad hoc 
manner, which reduces discontinuities without eliminating them 
altogether. Each 10-minute patch was subdivided into three equal 
subpatches. The least-square polynomial is calculated for the 
whole patch, but the hypothetical retrievals are computed and 
assigned only for the middle third of the patch. To provide for 
geographical continuity of the hypothetical retrievals, therefore, 
the 10-minute intervals used have a two-thirds overlap, so that 
the middle thirds of successively used intervals are chrondlogically 
contiguous . 

3 , 2 . 3. 3 Preliminary Results 

The effect that the degree of the least-square polynomial 
used has on the fit and on the continuity was investigated in a pre- 
liminary empirical study. We limited ourselves to linear, quadratic 
and cubic fits; experience has shown that polynomials of higher degree 
are unreliable for smooth data fitting due to their oscillatory nature 
The degree of the polynomial was further limited by the number of 
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retrievals available for the fitting since a fit based on in- 
sufficient data cannot be relied on. The actual criterion used 
was that the number of data must be rio less than one-third of the 
square of the number of coefficients to be determined by the 
fitting. Table 8 shows the minimum number of retrievals required 
by this criterion. 


Table 8 . Characteristics of 
Degree No. of Coefficients 


the Polynomial Pit 

No. of Retrievals Required 


1 

2 

3 


3 

6 

10 


3 

12 

33 


The preliminary empirical study to determine the appropriate 
degree of the fitting polynomial was applied to four sets of tempera- 
ture data processed by NESS from MIMBUS-6 radiance data, each being' 
subjected to 12 minutes of processing on an AMDAHL 470V/6 computer. 
These sets are described in Table 9 . 


Table 9, Data Used in the Preliminary Study 


Reference 

Description 

Initial 
Time Index 

Final 

Time Index 

Duration (Simulated 
Time in Hours) 

Winter 1 


" 28505 



Winter 2 

28685 

28698 

13 

Summer 1 

24738 

24750 

12 

Summer 2 

24548 

24568 

0 

20 


The durations vary between data sets liecause of missing retrievals. 

The goodness of fit of the three types of polynomials for 
the data described above is shown in Table 10. 

Table 10. Goodness of Fit (0°G) 


Degree 

1 

2 

3 

Winter 1 

1^67 

1.20 

0.94 

Winter 2 

1.40 

0.94 

0.68 

Summer 1 

1.24 

0.83 

0.58 

Summer ' 2 

1.15 

« 

0.75 

0*55 
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The goodness of fit is measured by the rootr-mean'r'Square (RMS) error 
of the polynomial values versus the actual retrieval values at the 
observation points ; the rms error shown is averaged over all manda- 
tory pressure levels. The best fit is given by the third-degree ; 
polynomials. This is to be expected, since the fit will improve 
with the number of parameters available, and the error will be zero in 
particular for a polynomial of interpolation. However, the improvement 
in fit shown in Table 10 is larger from first degree to second, than 
from second to third; this was the case for all data sets tested. 


A problem arises when a hypothetical retrieval at a grid 

■ ■ . li 

point can be evaluated in two different ways becaus^^ the gridpoint 

h 

a 

is in the vicinity of two different but proximate sjbts of retrievals. 

]) 

This is the continuity problem mentioned earlier. .4ie call the 
differences between the two values salti; for the data sets in Table 
9, we also computed- the RMS values of the salti. These RMS values 
are shown in Table 11, again averaged over all levels. 


Table 11. RMS of Salti (®c) 

The numbers in parentheses show the number of 
gridpoints for which salti were observed. 



1st Degree 

2nd Degree 

3rd Degree 

Winter 1 

2.35 (1062) 

1.93 (998) 

2.67 (603) 

Winter 2 

2.42 (1036) 

1.86 (993) 

1.82 (454) 

Summer 1 

1.98 (1102) 

1.62 (1073) 

1.72 (582) 

Summer 2 

1.96 ( 936) 

1.47 (884) 

1.65 (480) 


The magnitude of the salti are a measure of the smoothness 
of the fit as the intervals change. Table 11 shows clearly that 
polynomials of the second degree afford, in general, a smoother 
transition between intervals than those of first or third degree. 
When salti occur, our procedure is to average the two hypothetical 


retrievals and to jssi^n to the obtalnln, hypothetical retrieval 
the earlier of the two discrete times. 

Examination of Tables 10 and 11 shows that polynomials of 
the second degree appear to be the most suitable compromise between 
goodness of fit and smoothness of fit. 

3. 2. 3. 4 Conclusion / 

The computation of hypothetical retrievals using second- 
degree polynomials is currently being Implemented. We shall 
tse.the prefiltered asynoptic temperature data provided by this 
procedure as observational data for future assimilation runs based 
on SAM. The effect of prefiltering on initial states obtained with 

T forecasts from these initial states will 

SAM and on the qualxty of forecasts rro 

be assessed. 


3.2.4 Successive Correction Method CSCM) 

3.2.4. 1 Introduction 

h successive correction technigne has been applied to the objec 

!.• well as to the time- 

tive analysis of conventional synoptic data, as . 

1 f4 Dl assimilation of satellite 
continuous, four-dimensional (4-D) assimi 

asynoptic data. It is based on a simplified version of the method 
proposed by Begthorsson and Does (1955) and Implemented operationally 
for the purposes of synoptic objective analysis by Cressman (1959). 

TO the best of our knowledge, the application of this method to 
asynoptic satellite data is new. 
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3. 2. 4. 2 The Analysis JIethod 


The analysis method is essentially one of applying successive 
corrections to a first guess field. The first guess field is the 
model forecast field in all our applications. Corrections are 
determined as the difference between the observed data and the 
first guess field which is interpolated to the observation point. 

Linear interpolation is used to evaluate the first guess field at 
observation points from the four grid points surrounding the observa- 
tion (cf. Russell, 1975). Moreover, forecast values are computed 
at sigma levels, while the observations are giveni at mandatory pressure 

jl . 

levels; hence an interpolation procedure, linear in log p, is per- 
formed with respect to the vertical tCi obtain model values at 
mandatory levels. 

The model forecast value at the observation point, is 

thus given by: 



4 

L' 

j=l 


(J) . , Jin — 
Po 


i,2 


An« 


a 


£np2 - Anp^ 



here the subscripts 1 and 2 refer to the sigma level above and 
below a given mandatory level (£) respectively, while are the 
horizontal weights proportional to the area of the opposite 
rectangle of a grid box, as in the diagram below. 
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The observrations are taken one at a tin\e and the differeiice iS 

between the observation and the forecast at mandatory levels, 

6 » (3) 

is computed. If the lowest sigma level of a particular grid point 
has a pressure which is lower than that of the lowest mandatory 
level at that point, the model quantity is extrapolated to the 
mandatory level. In the case of temperatvire , the svirface temperature 
is used as the lowest level. If the model surface pressure is lower 
than the lowest mandatory-level pressure at that point, then the 
temperature is reduced hydrostatically to the value at the mandatory 
level . 

At this point, a quality check is made (see Subsection 3.2.1) 
if « exceeds a specified value, it will be ignored in further com- 
putation . 

The actual analysis is performed on the mandatory pressure 
levels, separately for each point. It consists of a number of 
successive scans. Each scan, indexed k, takes into consideration 
the observations that are within the scanning radius Dj, of the 
given gi'id point. The difference observation point i is 

multiplied by a weighting function given by Cressman (1959) as 



9 9 

Df - dr 

k r 

K ^ s 

Jv X 



where d^ is the distance between observation point i and the grid 
point we consider, and ? clearly w|^^-0 if d^>Dj^. 






The total correction Cj^ applied to a given grid point during 
scan k is given by 


N, 

j.k 1 1 


• i=l 


N. 



where is the total nvunber of observations within radius 'Dj^ of 
the given grid point. 

Note: Tests were made with 




w.6,(^) 


Z 

i=l 



(5*) 


as suggested by Stephens and Stitt (1970). Theoretical considerations 
suggest that division by N is preferable, and this was borne out by 
test results. • 


A number of scans is performed with successively smaller radii 
for each type -of analysis. Preliminary testing was carried out to 
determine an optimal number of scans as well as optimal scanning 
radii. 

3. 2. ^.3 Applications and Results 

The above scheme was implemented for the insertion of 
satellite data in GISS assimilation runs. The data consist solely 
of temperature profiles given at 11 mandatory pressure levels and 
are inserted in 10-minute intervals. Four scans are made with 
scan sizes of 700, 600, 500, and 400 km. Rvins were made covering 
the period from January 29, 1976 to February 21, 1976 with 72-hour 
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forecast runs made from 03Z on the days February 1,3,5,7,9,11,13,15, 

17, and 21. Sea level pressure and 500mb-height skill score and RMS 
error impacts over the NO SAT control run are shown for 48 and 72 
hours in Tables 12 to 15. These error measures and the corresponding 
impacts were computed as described in Subsection 3.2.1 (DIM). 

Experiment number 8310 consists of the insertion of conventional 
synoptic data by the direction insertion method (DIM) , and of the 
isnertion of vertical temperature profiles provided by NESS, using 
radiance data from NOAA-4 (VTPR) and NIMBUS-6 satellites, by the SCM 
method; in the insertion of asynoptic data we also used the standard 
rejection criteria explianed in Subsection 3. 2. 1.2 (Table 1) . A geo- 
strophic wind correction as in 3. 2. 1.3 is also made. Experiment 8310 
is thus comparable to DIM experiment 8186. Experiment number 8352 is 
similar to 8310, except for the use of special "quality” rejection cri- 
teria described in Subsection 3. 2. 1.2. It is thus comparable vho DIM 
experiment 8240, plus the utilization of VTPR data. The plots of the 
differences between 500 mb geopotential heights in experiment 8310 and 
in the NO SAT control run are shown in Figures 4a and 4b. 

A considerable net improvement in both skill score impact and 
RMS impact of satellite data over DIM results seems to be obtained 
when using SCM for the assimilation of the data. This can be seen 
from a comparison of Tables 12 and 14 with Tables 3 and 5 in Sub- 
section 3.2.1. A similar improvement can be observed by comparing 
in turn Table 13 and 15 with Tables 4 and 6 of Subsection 3.2.1. 

This improvement is observed, consistently in the algebraic amount 
1 of the impact (sign and maghitude) , as well as in the statistical 

I significance (ratio of the mean impact to its variance); it is 

‘ observed in all the verified quantities, with the possible exception 

H ■ 
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SLP 

Z500 


SLP 

Z500 


Table 12 
Experiment 8310 

Average Impact Over North America 


4 8 -hour 


RMS 

0.54±0. 38 
6.65±3. 33 


Skill Score 

1.7511.96 

1.5311.19 


72 -hour 


RMS 

0.7110.51 

5.6313.52 


Skill Score 
1.5713.19 
2.4111. 34 


Table 13 

Experiment 8352 

Average Impact Over North America 


4 8 -hour 

RMS Skill Score 

0.7210.31 2,2511.60 

0.2612.50 1.58 ±0.69 


7 2 -hour 


RMS 


0 .5710.46 
3. 2513.16 


Skill Score 

0.91±2-50 
1.0410.78 ■ 


SLP 

Z500 


SLP 


Table 14 
Experiment 8310 
Average Impact Over Europe 


4 8 -hour 

RMS Skill Score 

0.5810.35 2.4811.44 

7.1613.72 0.9311.96 


72-hour 

RMS Skill Score 

-0.5810.49 3.1112.49 

0.4914.85 -0.9613.51 


Table 15 

Experiment 8352 
Average Impact Over Europe 


48-hour 

RMS Skill Score 

0.3610.21 1.0410.78 

4.8212.88 0.5811.10 


72 -hour 

RMS Skill Score 

0.4010.42 1.8411.16 


Z500 


5.6812.45 


0.6811.49 


Figure 4a. Plot of the 
initial states produced at 03Z on tne 
using SCM, and by the control run. 
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of the RMS error in the SOOmb height verified at 48h over North 
America (Table 13 vs. Table 4), and of the SI score of SOOmb heights 
verified at 72h over Europe (Table 14 vs. Table 5) . The improve- 
ment cannot be explained either by the slight differences in quality 
control procedures between experiments 8310 (SCM) and 8186 (DIM) , 
or in the satellite data quantity between 8352 (SCM) and 8240 (DIM) ; 
it has to be attributed mostly to the different assimilation 
methods. The results for experiments 8310 and 8352 are summarized 
also in Subsection- 3 . 3 . 2 . 3 , as well as those for experiment 8240, 

The more general comparisons there support our conclusions here. 

The SCM procedure V7as also used for the insertion of conventional 
synoptic data in the GISS model with an ultrafine grid (2.5° x 3°, 
see Chapter 4) . The data consist of surface pressure and temperature, 
upper air reports of temperature, wind and relative humidity, and air- 
craft reports of temperature and winds. Assimilation and forecast 
runs were made covering the same period as above. Sea level pressure 
and 500mb height skill scores after 48 and 72 hours are shown in 
Table 16. No control run using DIM was available for the ultrafine 
GISS model, but some indirect comparisons are made in Chapter 4. 


Table 16 


Average Skill Scores of Ultra-Fine NO SAT Assimilation 






AVG 

SD 

SE 

48 

HR 

SLP 

N.A. 

6 7.06. 

9.05 

2.73 

72 

HR 

SLP 

N.A. 

74.25 

11,20 

3. 38 

48 

HR 

Z500 

N.A. 

35.99 

4.87 

1.47 

72 

HR 

Z500 

N.A. 

42.57 

6.51 

1.96 

48 

HR 

SLP 

N.A. 

58.99 

5.29 

1.60 

72 

HR 

SLP 

EUR. 

68.14 

7.63 

2.30 

48 

HR 

Z500 

EUR. 

54.07 

6.29 

1.90 

72 

HR 

Z500 

EUR. 

61.66 

7.20 

2.17 


3. 2. 4. 4 Conclusions and Recommendations 

Analysis of skill score and RMS results suggests a modest 

but consistent improvement achieved with the SCM method over the 
direct insertion technique when applied to the time continuous, 4-D 
assimilation of asynoptic satellite temperature data. 

The effect of the SCM method on the insertion of conventional 
synoptic data has yet to be fully analy 25 ed. Analysis of sea-level 
pressure and 500 mb height charts suggest that at the least, the 
SCM analysis is somewhat smoother than that produced by the direct 
insertion approach. 

Further analysis is needed specifically to determine optimal 
scanning radii and number of scans; such optimization may further 
improve results. 

3,2.5 Asynoptic Variational Method For Satellite Data Assmimilation 

(M. Ghil and R. Mosebach) 

3. 2, 5.1 Introduction 

One of the most promising approaches in the objective 
analysis of synoptic data has been the variational method pro- 
posed by Sasaki (1958). This method has been further developed 
and applied to more and more realistic problems and to real-data 
studies by Sasaki (1969, 1970a, b, c) , Stephens (1970), Lewis (1972), 
Lewis and Grayson (1972), and Achtemeier (1975), among others. 
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The main idea of the approach is to obtain an analyzed field 
which is as close as possible to the observations, while at the 
same time satisfying exactly or approximately certain dynamic re- 
lationships which are believed to hold for the true fields. When it 
is required that these relationships be satisfied exactly, these 
relationships are called strong constraints , when satisfied only in 
an approximate sense, by minimization, they are called weak constraints . 
The most coimnon relations or constraints chosen thus far have been 
those aimed at preparing the initial state in such a way as to 
prevent inertia-gravity waves from developing unrealistic amplitudes 
and cause serious and rapid deterioration in the forecast from this 
initial state. 

We decided to. attempt the adaptation of this method to the 
time-continuous, four-dimensional assimilation of satellite-derived 
temperature data. For this purpose it seemed reasonable to apply 
the variational method to grid point values surrounding a limited 
area of observational data. Satellite sounding data obtained 
during a short time interval comparable to the forecast model 
integration time step extend over such a limited area. The method 
provides a rational procedure for inferring from temperature data 
the values of other meteorological variables, such as the winds, 
at adjacent grid points. This inference is based on the natural 
coupling between variables given by the variational constraints. 
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The variational method also provides in this context a dynamically 
consistent way of obtaining a smooth transition between the values 
of the variables in the limited area in which they have been 
corrected by the instantaneously available observations , and their 

values in the surrounding domain. 

The limited-area approach dictated by the nature of the 
application also influenced the choice of minimization technique 
to be used. The variational method essentially consists of 
minimizing a functional of the functions to be determined; in our case 
these functions are the meteorological variables, regarded as functions 
of position at given, fixed time. This minimization must be performed 
in the presence of constraints, the latter being usually included 
in the functional itself by the use of Lagrange multipliers. 

The minimization technique which has been widely used in 
meteorological applications is based on the derivation and solution 
of the Euler-Lagrange equations corresponding to the functional 
which is to be minimized. The solutions of the Euler-Lagrange 
equations yield extrema, in particular the desired minima, of the 
functional. These equations, however, turn out in general to be 
lather complicated partial differential equations, and in meteoro 
logical applications they are often of mixed elliptic-hyperbolic 
type. The latter fact creates a difficulty in their numerical solution 
This difficulty has been circumvented in some of the quoted 
literature by modifying the equations or the data, so that the 
equations after modification become elliptic everywhere and thus 
solvable by standard numerical methods. The shortcomings of such 
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an approach have been pointed out by Ghil (1975) in a slightly 
different context; numerical solutions for a meteorologically 
significant problem of mixed type have been given by Ghil and 
Shkoller (1976), and by Ghil et ~al . (1977). 

For the immediate needs of the Impact Test Project, instead 
of developing numerical methods for the solution of the relevant 
Euler-Lagrange equations, it seemed more expedient to use a direct 
m inim i zation technique. The use of such a technique was also 
facilitated and made rather natural by the relatively small number 
of points involved in the limited-area application, 

3. 2. 5. 2 The Method 

The meteorological variables which we wish to adjust in the 
neighborhood of satellite temperature retrievals are the horizontal 
velocity field V = V(A,0,o), the surface pressure ir = ir(A,9), and 
the model temperature field itself, T = T(A,0,n). Unsubscripted 
symbols shall denote the values of the variables which are used 
by the model in the next time step of the data assimilation process. 
The superscript ( ) ° shall denote the values of the variables 
which we desire to approximate as closely as possible while still 
satisfying the selected constraints. Thus T° is the temperature 
given by satellite observations, ir° is the surface pressure fore- 
casted by the model durihg the assimilation process for the time 
in question; and V° is obtained from T° and forecast values of V by 
the geostrophic correction formula mentioned in Subsection 3.2.1. 


The functional we wish to minimize is 


F(T,tt,v) =/ajv-v° I -+3 (u’-Tr°) + (T-T°) 2 ; (l) 

here a,3,T, and 6 are positive constant weights. The constraint 
chosen is that tTj_ be as small as possible, i.e., that spurious 
pressure tendencies be eliminated. The expression used for 
in the evaluation of (1) is 

7r. =-v-/^irVda (2) 

We notice that the weak constraint (2) couples ir and V, but not 
T. Therefore F will be decreased by as much as possible with 
respect to T by simply setting T=T°. However T'’ enters, as 
mentioned previously, into the definition of V°. 

In actual computations the continuous functions T, it, and 
V are approximated by discrete functions defined on a fixed grid, 
the integral in (1) is approximated by a sum. For instance, 
with a the radius of the Earth, and AS a discrete area element, 

/B (7i-iT° ) ^ (A , 0 , a)a cosOdXdPdcr > I. . , (iT-if®) ^AsAa) . . , ; (3) 

i,3,k 

similar approximations are made for the other two terms in the integrand 
Both and |v-V°| are evaluated in a way consistent with the finite- 
difference formulation of the GISS General Circulation Model (GCM) 

(Arakawa, 1972; Tsang and Karn , 1973; Ghil and Mosebach, 1976). 

After discretization, P becomes just a simple quadratic 

function of the individual grid-point variables tt. V. . A 

13 ^ k 

large number of methods exist for minimizing such quadratic func- 
tions of a large number of variables. The technique we chose is 


an adaptation of the conjugate-gradient method of Powell (1964) ; 
this method does not require the computation of derivatives, 
which is expensive. The basic program which was adapted to our 
application is a Fortran program due to N. Rushfield (1970, personal 
communication). Its flowchart is given as Figures. 

Choosing Conjugate Directions. The method essentially 
consists of successive searches for the minimum along n linearly 
independent directions, where ri is the total number of variables. 

The search occurs first along the coordinate axes corresponding 
to the n variables. These n searches constitute the first iteration. 
At the end of the first and of each following iteration, one 
direction of search is changed, according to a certain algorithm. 

1^ principle, the method needs iterations to determine the n 
directions which are mutually conjugate , in a well-defined sense, 
with respect to the particular quadratic to be minimized; at the 
end of these iterations the location and value of the minimum 
are found. Thus, only a number of function evaluations of the 
order of n should be needed to find the minimum. 

In practice, new directions found according to the basic 
algorithm can be close to being linearly dependent. To avoid 
this and ensure a reasonable converge rate, changes in the 
algorithm are necessary and have been implemented in the program 
(cf. Powell, 1964; Rushfield, 1970). 

The Line.ir i'oarok. The search along each direction is 
performed independently of the other directions. The crucial fact 
about mutually conjugate directions is that for such directions. 
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•FSQ — RSTEP 


MAIN CONTROL 


CGRAD 


-| FSQ RSTEP 


•SLMIN — FSQ — ^RSTEP 


RSTEP 


-RSCALE 


-RCOMPl RAVRX 


Figure 5. Variational Method Flowchart 




Function FSQ computes the value of the function F, 

SLMIN performs the linear search along one direction, CGRAD 
chooses a new direction to replace an old one; RSTEP, RSCALE, 

RCOMPl, and RAVRX are subroutines used in the function evaluation 
and consistent with the GISS GCM. 
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will yield the minimum 


and only for them, n independent searches 
of the gxven quadratic. The search is basically done by deter- 
mining triplets of points along the direction searched and 
fitting parabolas through them. The idea is that the turning 
point of such a parabola is an approximation to the minimum along 

the given direction. The detailed linear-search algorithm is given 
in Table 17. 


Lonverge^iae Critei->ion. Convergence is assumed if after 
any iteration none of the variables have changed by more than a 
prescribed small quantity e. The more complicated criterion 
proposed by Powell (1964) does not seem to be necessary in the 
case of a quadratic function like the one we attempt to minimize. 

3 , 2 . 5. 3 Preliminary Results 

A?ialyii^ Test Cases. The program was tested by attempting 
the minimization of a number of analytically prescribed quadratic 
functions of up to 100 variables. The convergence criterion was 
taken to be a change of not more than e = .02 in any vtri ..>ie. 
Sample cases are presented in Table 18 . All computations were 
carried out with a Fortran H compiler and an optimization level 
OPT = 2. The computer used was either an AMDAHL 470V/6 or an 
IBM 360/95 machine. Computing times on both are quite similar, 
and the ones listed correspond to the AMDAHL computer, which 
are in general slightly larger. We notice that for all test 
cases in Table 18, convergence was achieved within a few iterations, 

Real Data Tests. The method was tested for a nine-level 
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iaDj.e 17, 


Description of the Linear searoh Algorithm 


(1) Start with the initial value of the function, F. 

(2) Move along a specified direction by a specified amount, 
changing one (for the first iteration) or more (for 
successive itertions) of the variables and get a new 
value of the function, F'. 


(3) 


(4) 


continue until at point C the value of the function is 

greater than at a previous point B. Call point reached 
before B, point A. 

Three points are now defined. Fit a guadratlo form to 
these points and find the turning point of the guadratio 
(point D) . If the turning point is a minimum and if D 


IS sufficiently close to A, 
As the minimum. Otherwise, 
A, B and C and repeat Step 


B, or C, then choose point D 

take point D and the two points 

4 . 
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Table 18. Test Cases for Variational Technique 


Function F 


Initial Cues s 


No. of Time for 

Iterations Computation* 


F = S (x . ) 
i=l ^ 


= 1.5 for all i 


.15 min. 


2 

F = 2 (x-i)^ 


x^ = 1.5 for all i 


.13 min, 


100 _ X. = 1.5 i<10 

F = E (x-i) ^ 

i=l x^ = 0 i£l0 


.19 min. 


2 

F = Z sin (x . ) X . 
i=l 


I 

1 4 

random variable 
with normal 
distribution 
about 0, range; 
[- 1 , 1 ] 


16 min. 


2 2 

F=x^-2XiX2+X2 X. = -4 

X2 = 2 


13 min. 


±\J p 

F=Z sin (2x.+3x.,, ) x. = a. ^ 
i=l 1 1+1 1 1 4 


random variable 
with normal dis- 
tribution about 
0, range: [-1,1] 


P=Z (2x.+3x.^^)^ X, = a, ^ 


i=l 


a = random variable 
with normal dis- 
tribution about 
0, range; [-1,1] 


.12 min, 


.78 min. 


*Computations were performed on an Amdahl 470V/6 with compiler optimiza- 
tion level 0PT=2. 
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2x2 square of the GISS GCM computational grid corresponding to the 
indices J=10,ll, 1=10,11 (cf. Tsang and Karn, 1973; see also Fig. 8). 
This means that 76 variables were involved (72 horizontal wind 

component values + 4 surface pressure values) . The observed values 
for this test were taken from the NMC analysis at OOZ August 23, 

1976. The results are shown in Table 19.. After the first iteration 
the variables do not change appreciably. In fact, the convergence 
is assumed after only two iterations, with the convergence criterion 

^ ^ ^02 (i.e., less than a 2 percent change in all of the variables.) 

Figures 6 and 7 show the percentage change in the zonal wind for 
each level at particular grid points. 


The basic problem in the implementation of this approach is 
that the time necessary to calcxilate the function is large. Since 
each linear search requires that the function be computed several 
times, and since each iteration requires a linear search over as 
many directions as there are variables, reducing this computation 

time is crucial. 


Referring again to Table 19, we see that 13.3 seconds are 
required for one iteration. The problem arises when we realize 
that we are only dealing with 76 variables - and that the computation 
time is quadratically proportional to the number of quantities. 
Thus, if we were to deal with a patch of 5 x 5 grid points, we 
would increase the time for one iteration to: 


25 X 25 
4x4 


13.3 


sec 

iter. 


8.66 


min 

iter. 


This number of grid points is typical of the patch size involved in 
some other assimilation methods discussed in this report for 
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The time 


Table 19. Results for a real date test of AVM {see text). 

required per iteration was 13.3 sec. 
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Change in 'Ll" winds after variational corrections 



Percent Change 


Figure 6 . 
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aealln, with satellita-dative. te„petat„e data obtained over a 

10 minute time interval. 


The hope is that the time win increase less than quadratical- 
ly or that some other way will h« • • ^atical 

estimate o envisioned to reduce this ti.e 

stimate. °ne way would be not to perform the th 

. ^ rorm the three-point zonal 

ever!Ze'"'^'’r““" Oifferencinq scheme 

every time we calculate th^ • 

function. Results for this latter pro- 

edute are given in Table 20 air 

ihd variable values after thj ■ 

after the variational corrections equal the ere 

Vious ones to at least thr-^ • . ‘J he pre- 

at least three significant digits. 


3.2,5.i( Application To Large Regions 


the moment, the_time problems, experiments 
a sa7ir“ " 

The „.s d ^ P-th. 

H S denote the qrid points where satellite temperature data 

were obLained. oeostrophic corrections were made to winds a 

these points, in addition to those marhed with fs. We shall 

attempt to apply the vp>»-ia+.- 

PP y the variational method to the entire region 

the lading the shaded area, .he site of this region is taZ 

Of thel7r!eTva°riableI"°"‘"°''’""“' 

es in the avm function F are chosen to 

be the current model values for the shaded 7 

tne shaded area. That is, 

the shaded area the values are th« 

are the same as before the 

insertion, the grid points marked with H's or fs now have 
geostrophically corrected values. 

Ah iMtediate problem to be faced is the site of the matrix 
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Table 20. Same as Table 19, but with ARVX computation omitted (see 
text and Fiqure 5). The computation time was reduced to 11.3 sec. per 
iteration. Results are the same to within the required accuracy. 
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DESCRIPTION 
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U which determines the directions chosen for e.ch linear search 
Powell, 1964). For a 25 x 25 patch this matrix would have 
dimensions of 11825 x 11825 or use 559 megabytes of storage. It 
may be possible to write the matrix u to dislc one line at a time. 

For testing, we set u equal to the identity matrix, which is equiva- 
lent to choosing the directions as the variable^ themselves (i.e., 
always varying only one at a time and never a linear combination ’ 
thereof) . If convergence is fast as in the '2 x 2 case this seems 
to be the best idea anyway, since the matrix only changes after the 

first Iteration. As of now, there are no results for using the 
AVM on this expanded region. 

3 . 2 . 5, 5 Concluding Remarks 

The asynoptic variational method (AVM) formulated herein seems 

promising, both dynamically and computationally. We expect 

that only one or two iterations of the conjugate-gradient algorithm 

used are needed in real-data applications , this will achieve the 

adjustment of meteorological variables to values which are within 

Observational error of the satellite-derived values, and which 

also satisfy the dynamical constraints we impose. A number of 

approaches are being pursued to reduce the computational time 
required. 
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3.2,6 Filtered Equations Method (FEM) (l. Peng and b. shicoiier) 

3. 2. 6.1 Filtered Equations Method, I; Preliminary Tests Of 
A bLOBAL Balance-Equation Model 

3.2. 6.1.1 Introduction 

Since four-dimensional data assimilation was first pro- 
posed by the GAEP study Conference at Stockholm in 1967 as a 
technique to obtain a better representation of atmospheric synop- 
tic states, a large number of assimilation experiments have been 
carried out using primitive-equation models (see the reviews by 
Bengtsson, 1975, and by McPherson, 1975). One of the major objectives 
Of these experiments was to reduce or damp the spurious onset of large 
inertia-gravity waves, often referred to as -initialisation shock", 
these -shocks- were excited by the insertion of data, particularly 

data were used, and have to be considered meteorologically 
as "noise". It has been found that requiring local balance between 
corrections of the mass field and the wind corrections can reduce 
the excitation of inertia-gravity waves and hence accelerate the 
assimilation process (Rutherford, 1973, stone e^. , 1973 , Kistler 
and McPherson, 1975). A more far-reaching solution of the’ noise prob- 
lem seems to be the use of a filtered model. It is expected that in 
a filtered model the inserted information will be effectively ab- 
aorbed without contamination by excited gravity waves and that 
the impact of insertion will be enhanced. The crucial question is 
then: How accurate can the evolution of atmospheric synoptic 

States be described by a filtered model? 

The most complete and accurate system of equations which 
does not admit high-frequency oscillations is the system of balance 
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equations (Bolin, 1955, 1956; Charney, 1955; Monin, 1952, 1958; 
Thompson, 1956) . The major way in which this system differs from 
the full baroclinic primitive-equation of large-scale atmospheric 
flow model is the omission of the terras in the divergence equation 
which are related to the irrotational component of the horizontal 
wind. Charney (1962) has shown that this system can be obtained as 
a second-order approximation in the expansion of the primitive equa- 
tions in terms of the Rossby number, R^; in addition, a term arising 
from the beta effect on the irrotational wind appears in the balance 
equation in the case of planetary scales. According to Charney (1973) , 
the expansion holds even for R^ = 0(1), provided the Richardson number, 
R^, is sufficiently large for (R^R^) to be small. Most recently, 
Moura (1976) examined the accuracy of the balance system for describing 
slow, large-scale motions in the atmosphere; he considered solutions 
of a linearized form of the system and compared them with solutions 
of the linearized Laplace tidal equations, as obtained by Longuet- 
Higgins (1968). The results show that the balance system describes 
well the slow, large-scale atmospheric motions, except the Kelvin 
wave which is not a solution of the system ^ The previously mentioned 
additional term in Charney 's balance equation corrects this deficiency, 
but introduces additional unrealistic high-frequency modes. Despite 
this Kelvin wave deficiency and possible inadequacies in the case of 
rapid synoptic development (as mentioned by Bolin, 1956) , or in the 
presence of strong heating (Charney, 1963; Murakami, 1972), the use 
of a filtered global weather prediction model based on the balance 
system seems feasible. At least, it is worth the effort to test it. 

Aside from the question of its physical applicability, 
the balance system presents a serious mathematical problem in 


solving it. The complicated nonlinear balance constraint between 
mass distribution and motion makes it very difficult to obtain a 
single diagnostic equation which could be solved for the irrotational 
wind or for the vertical velocity; it is even more difficult to 
obtain a mathematical condition guaranteeing the existence of a 
solution for such a diagnostic equation. Because of these dif- 
ficulties , all the reported methods of solving the balance system 
are iterative and not known a priori to converge. Charney (1962) 
has found, in integrating the system over North America, that the 
iterative method he proposes will converge only if the potential 
vorticity is positive and he suggests to impose this constraint on 
the flow. The implication of such a constraint is, however, not clear 
in the case of cross-equator flow. Masuda (1971) reports some test 
results of a pseudo-hemispheric balance model in which the values 
of the Coriolis parameter f used by the model between 30*^N and the 
equator are modified so that the modified f^ decreases linearly toward 
a non-zero value, 2nsin (it/6) , at the equator. All these considera- 
tions indicate the kind of difficulties one would encounter in work- 
ing with a global balance-equation model. 

The purpose of this work is to formulate a global balance- 
equation model for numerical weather prediction, to test its fore- 
casting skill, and to assess its potential as a tool for data 
assimilation. The model equations are given in Subsection 3. 2. 6. 1.2. 
The method of solution is described in Subsection 3. 2. 6. 1.3. The 
results of forecast tests and their discussion follow in Subsections 
3 . 2 . 6 . 1 . 4 and 3 . 2 . 6 . 1 . 5 . 

The potential of the balance system as a data assimilation 
tool is discussed in the next Section, 3. 2.6.2. 
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3 . 2 . 6 . 1.2 The Model 


r, For the convenience of handling boundary conditions at 

the Earth's surface our filtered model uses the so-called sigma 
coordinate system; this has the added advantage of facilitating 
comparisons with the existing GISS Primitive Equation Model. In 
a coordinates, the basic equations governing atmospheric large- 
scale, quasi-horizontal motions may be written as follows: 


9V 3V 

— = -(V«V)V - u ^ V TT - - fJc X V + F 

at 3a *■ 


( 2 . 1 ) 


a$ 

3 o 


RT Tt 
P 


(2,2) 


air 

at 


V • (irV) - 


( 2 . 3 ) 


f^(TrT) = 


1<^TV) -|^(irTa) -£M!1(V=^X +, 


8 a 

3 a 


£) . TL_Q 
o C 

P 


( 2 . 4 ) 


3 (irq) = 

at 


V • (irqV) -4-(Trqa) + it (E-C) . 

— 3 a 


( 2 . 5 ) 


Here 


t = time, 

a - the vertical coordinate, (p-p^.)/ (p^-p^) , 
p =^^^ssure, 

p^= prilssure at the top of model atmosphere, assumed constant, 
p_= pressure at i^ttom of model atmosphere 

» = - '’t ' 

V = horizontal velocity • 
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V = gradient operator on constant a - surface, 
a = da/dt, 

k = vertical unit vector, 
f = Coriolis parameter, 

R = gas constant, 

Cp= specific heat at constant pressure, 

Q = heating rate per unit mass, 
q = specific hvimidity , 

E != evaporation rate , 

C = condensation rate , 

$ = geopotential , 
t = temperature / 

F = horizontal friction force . 


Let us write 


V 



+ V 
-X 


V, = k X Vijj 

- - 



= V X . 


( 2 . 6 ) 

(2.7) 

( 2 . 8 ) 


we apply the curl operator Vx to Equation (2.1): the vertical component 
of the resultant gives: 


(|_ + v-v + fi)- •(2-“^’'p)° 

k • (7 X F ) . 


(2.9) 


The dot-differentiation V' , of (2.1) gives: 

,, av 


3t °3c' J 

. y.yji, - V(y-yv) = I't 
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Equations (2.9) and (2.10) are respectively analogous to the vortici- 
ty equation and the divergence equation in the p- or z- coordinate 
systems . We neglect the terms quadratic in x and a in the vorticity 
equation, and all the terms involving either x 6 in the divergence 

equation, this yields 

L-v^ip = -V*{(V% + f)V} - - k- (2.11) 

9 1 ^ 

+ oRVM-Vtt) - V‘(fV-«ij) + yvlv'f-Vij)) - V‘ { (V i>) = 0. (2.12) 

The second equation is the so-called balance equation, which 
expresses the balance constraint between mass distribution and 
motion and, according to Thompson (1956) and Bolin (1956), 
filters out gravity waves. 

Equations (2.11) and (2.12) may replace (2.1) and form 
a complete system of equations with Eqs. (2.2) to (2.8). The complete 
system obtained by this replacement is the system of balanc e 
equations in o coordinates; they are the equations governing our 
model. This balance system can be justified by a scale analysis, 

similar to the analysis of Charney (1962) ; such an analysis is 
beyond the scope of the present report. 

The top and bottom boundary conditions are; 

0=0 at a = 0, and a = 0 at a = 1. 

With these boundary conditions, (2.3) determines sea-level pressure 
tendency, namely, 

i_7r = C^V)<^CT* 


There is no need for lateral boundary conditions 


in a global model . 


3 . 2 . 6 . 1,3 Method of Solution, 

Sxnce xt xs not possible to determine the fields of x and 

5 diagnostically from the other fields, we seek x and d simultaneously 

with the other unknowns. To do so, we replace Equations (2.2) 

and (2.12) by their local time derivatives and treat dip/dt, 3T/3t, 
dn/dt, 3<?>/9t, 3q/3t, x, and d as unknowns of the new system of 

the equations. After substitution and rearranging terms, the new 

system of equations may be rewritten as follows’: 

3 ' 


V }p - -(kxVip) ^(V ip + f) - { (V + f)Vx) 

■ I* -(^ VTxVTr]*k + k-^ 3 ^) 

9 / r ^ ITT T 1 2 

J^-^a + RaV. (- Vtt) - V- (fViP) + |v (Vt|; • ViJ; ) 

2 

- V* (V \pv 41 ) } = 0 

^(7rT) = -(kxVi|;)-V(TTT) - V* (ttTVx) -|-(irTa) 

0 0 


(3.1) 


(3.2) 


cRtt 


X ^ If - 1) + ^ 

P p 

3 y 

= -^xVti^^VTT - V* (ttVx) - l^(TTa) 
g-^(TTq) =- (kxVi|0 *V (rq) - V(Trq^X) "■ + Tr(E-C) 


(3.3) 

(3.4) 

(3.5) 


Equatxons (3.1) to (3.5) are solved for 3i^/3t, 3T/3t, 37r/3t, 3q/3t, 
X, and a with the top and bottom boundary conditions. 


<y - 0 at a = 0 and a = 1 . 


(3.6) 
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Our inodel atinosphers is global and hsnc© no physical 
lateral boundaries are present. This is an important advantage, 
since fictitious boundaries cause errors that eventually propagate 
throughout the computational domain. Because of the lack of a 
suitable global plane projection which does not seriously distort 
some areas, however, the difficulties associated with lateral 
boundary conditions do not completely vanish in a global model. 

If two or more plane projections are "patched" together to represent 
the globe, difficulties arise in the patching area. if a spherical 
coordinate system is employed, care must be taken to avoid 
singularities at the poles while asymmetry will still be allowed 
there. The use of the scalars ip, x instead of the two-vector V 
is an important advantage in this respect. 

Our model uses a multi-level latitude-longitude grid system. 
Both poles are grid points. At each pole, we treat each discrete 
variable as the average over the area bounded by the latitude 
circle half-way between the pole and its neighboring grid points, 
and Equations (3.1) to (3.5) are averaged over this area. The areal 
integration of the divergence or the curl of a horizontal vector is res 

pectively reduced to meridional fluxes across or zonal circulation 
along the previously mentioned latitude circle. 

The numerical procedure of our solution method is primarily 
a block relaxation method. It is described below. We start from 
a certain first guess of the dependent variables, and then suc- 
cessively adjust the variables block by block until the solution is 
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reached within a certain error. Each block consists of all the 
discrete dependent variables along a vertical line of fixed 
IstitudG and longitude, ^ 

In our multi-level latitude-longitude grid system, the 
discrete dependent variables are only staggered in the vertical 
direction,- d is represented at the mid-point between the levels. 
While all the other variables are represented at each level. The 
Jacobian representing advection in the vorticity equation is 
approximated by Arakawa’s (1972) scheme, other nonlinear transport 
and divergence terms in the system of equations are approximated 
by the box method, and the usual centered difference scheme is 
employed in the remaining terms. In. terms of the discrete 
variables in the grid. Equations (3.1) to (3.4) may be written 
for an N-level model as follows: 


4N 

Jl = Bp(i,j), 


p = 1,2, ...,4N, 
i = 1,2,. ..,1 ^ 

j “ 1,2,...,J • 


(3.7) 


where, for each horizontal grid point (i,j), the 4N-dimensional 
vector (i,j), is the transpose of 

f X I r X I 
ijN ijl ijN 


r til.) (iji) 

13 I idN 1]1 ijN ijl i- 


'>iJ,N- I' >. 
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i, 0 function of ,, .„a T only, „„n. 

the ‘lN“dimon«ianaX voetoc B n •; 

MotoL, B ( 1 ,J), , 5 , „ot only a function of „, J,, 

and T, but £» 1 <?a . ^ 

a luncuon of XJi'.ri, (i'.y, ^ a,j>. 

Par given Initial conditions, t, q, „, a„a v at t = t , 

tho equation , ' 

V tj- Ji’(VxV) 


in solved for ,ne first gness for x„,i, 3 , is «.on oOtainoa 
JToUow^. ^ 13 3et equal to tero overywhe,eo ; & and air/H are" 
eomputed from the eontinuity equation and the boundary condition 
(-i.6), f,i,naUy, a>|./0t and are computod from the vorticity 

equation and the first iaw of thermodynamics, respectively. For 

t qreater than t^, the first quess of X^(i,j) takes the final value 
of x^^(i,;)) at the previous time stop. 

'fha iuteqration of Equations (3.1) to (3.6) consists 
simply in the followinq algorithm: 

(a) Cij.ven t|t, n, f, q, and a first guess of >^",„(i,j) at 

tio.o t, compute the forcing functions £, Q, b-c, a„a the coefficient 
matriee.s A (i, i) . 

(b) I'crfor.n block rclawtion,. i.o., for fu-oa (i,j) 

compute for all p, using tho current x^(i'j') (i,j),. then 

Holve (3.7) for new x (i^)), m « I 

4N; do this for all (i,j) 
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successively. Repeat the process until for each in the differences 
between the corresponding vectors Xj^(i,j) of two consecutive 
iterations become less than e*Max(X^), for all (i,j), where e is 
a small prescribed constant. 

(c) Calculate ir, and T at t+At from the final x^(i»j) 
of (b) by a leap-frog scheme (use forward extrapolation for the 
first time step) . 

(d) Make a convective adjustment if the temperature lapse 
rate becomes superadiabatic . 

(e) Calculate q at t + At directly from. (3.5). 

Steps (a) through (e) are performed first for t = t^, then for 
t = t^ + At, t^ + 2At and so on, until t equals the time up to 
which we wish to forecast. 


In closing this section, we wish to point out that the 
replacement of the original diagnostic balance equation by its 
prognostic form relaxes the balance requirement while still 
preserving the filtering property. In other words, because the 
model uses the balance relation between the time change of the 
wind field and that of the mass field, the initial wind and mass 
fields need not be balanced, and accordingly, the predicted wind 
and mass fields are not necessarily in balance. However, the 
amount of imbalance in the initial data is preserved throughout 
the integration, and not increased. 
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3. 2. 6.1.^ Some Preliminary Tests. 

The version of the balance-equation model that was tested 
has three levels and a horizontal grid-spacing of 4° latitude and 
5 longitude. The ground surface height at each grid point is 
the same as in the GISS primitive-equation (PE) model (Somerville 

et__^. , 1974). Friction and non-adiabatic heating were not included. 
The data sets used for the initial conditions were horizontal 
wind, temperature, and surface pressure spatially interpolated to 
the GISS grid from the National Meteorological Center's objective 
analysis. The predicted sea-level pressure and 500-mb geopotential 
height fields after every 12-hour interval following the initial 
conditions were compared with the corresponding NMC analysis, and 
the skill-scores (see, for instance, Druyan, 1974, for definition) 
and root-mean-square errors were computed. 

In a few tests, our model forecasts were also compared 
with the forecasts made by the three-level, adiabatic and frictionless 
version of the GISS PE node! (A. Beyliss, personal oomn.unioetion , 1976) 
using the same initial conditions, in one case, further comparison 
was made with a 24-hour forecast by the nine-level, adiabatic and 
frictionless version df the GISS PE model. 


The length pf the time step At was 0.5 hour for some tests 
and 1 hour for the others. When At = Ih was used, smoothing was 
performed near the poles. For the initial time step the convergence 
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of our iterative method is slow, because we started with x ~ 0 every- 
where. It needed about 65 interations to satisfy the convergence 
test with e = .005. Afterwards, convergence was reached in 5 to 
10 iterations for e = .01. 

Each test was terminated after 4a, or after 60 hours depending 
on the quality of the forecast. We focused our attention particu- 
larly on the quality of the forecasts over the United States and 
neighboring areas, because the verification of the forecasts is 
more reliable over this region. 

The quality' of the model forecast varied considerably from 
one test to another. The worst and the best test cases, respective- 
ly, are the forecasts made from initial conditions at OOZ January 1, 
1975 and OOZ August 18, 1975, respectively. Tables 21 and 22 show 
the skill scores and rms errors in the predicted sea-level 
pressure and 500— mb geopotential height fields in the former and 
the latter cases, respectively. For comparison, we also show in 
the tables skill scores and rms errors for the corresponding fore- 
casts made by the three-level, frictionless and adiabatic version 
of the GISS model. It is clear from the tables that at least for the 
three-level frictionless and adiabatic version of the models, the 
balance-equation (BE) model, even at its worst, is equal to or better 
than the PE model . 

In the remainder o,^ this section we discuss four test 
cases in some detail. The first one is the worst case mentioned 
above. Figure 9 shows: (a) the initial sea-level pressure (SLP) 
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Table 21. s 
made with t 
the balance 
models with 


Elapsed Time 


12 hours 


24 hours 


Region 


skill scores and rms errors of the forecasts 
tie 3- level, adiabatic frictionless versions of 
-equation (BE) and primitive-equation (PE) 
initial data as of OOZ January 1, 1975. 


Region 


Sea-Level Pressure Error 
S, (%) rms (mb) 


500 mb Height Error 
Sj^(%) rms(m) 



BE 

PE 

BE 

PE 

BE 

PE 

BE 

PE 

A 

51.3 

57.6 

4.0 

5.9 

28.7 

35.7 

47.2 

54.8 

B 

49.8 

74.2 

1.8 

3.6 

49.3 

61.4 

14.8 

21.2 

C 

50.1 

56.8 

5.3 

6.1 

32.0 

36.7 

55.8 

59.7 

D 

52.8 

61.9 

4.6 

5.9 

40.7 

44.7 

55.3 

61.0 

A 

69.9 

73.6 

7.2 

8.1 

48.6 

51.5 

73.8 

74.5 

B 

59.5 

82.0 

2.7 

2.9 

62.9 

65.8 

31.0 

25.1 

C 

67.1 

71.9 

6.9 

7.3 

43.7 

44.8 

64.5 

64.9 

D 

66.0 

72.3 

6.4 

6.9 

49.5 

49.9 

61.7 

62.5 

A: 22“N 

- 62 

“N and 

40“W - 

140“W 






B; 22“S - 22°N 
C; North of 22“ 
D: Global 


Table 22. 


Elapsed Time 


12 hours 


24 hours 


Region 


Same as Table 21, but for initial conditions as of 
OOZ August 18, 1975 


Sea-Level Pressure Error 500 mb Height Error 


Region 

^1 

(%) 

rms (mb) 

S3^(%) 


rms (m) 


BE 

PE 

BE 

PE 

BE 

PE 

BE 

PE 

A 

40.4 

71.4* 

2.1 

4.3* 

32.9 

34.4 

25.0 

41.6 

B 

42.5 

77.8 

1.5 

3.4 

52.1 

67.7 

12.6 

22.5 

C 

41.1 

55.9 

-2.3 

3.7 

35.5 

36.8 

25.6 

30.7 

D 

44.4 

57.6 

3.9 

4.5 

40.3 

41.8 

37.8 

37.6 

A 

56.8 


3.4 


39.6 


31.4 


B 

53.1 


2.3 


59.0 


16.8 


C 

56.0 


4.1 


42.7 


39.9 


D 

60.7 


7.0 


48.8 


66.0 


: 26 “N 

- 78“N 

and 40 

“N - 140 

“N 






B: 22»S - 22“N 
C: North of 22 ®N 
D: Global 


♦Computed for a region somewhat smaller than region A 


distribution over North America and the neighboring oceans at OOZ 

if 

January 1, 1975, (c) the observed SLP distribution at OOZ January 
2, 1975, (b) and (d) , the 24-hour forecasts by the three-level BE 
model and by the three-level PE model, respectively. 

The observed significant synoptic developments in this area 
during the 24-hour period from OOZ January 1 to OOZ January 2 were 
as follows. The high pressure near the west coast moved eastward 
across the United States. A cyclone deepened rapidly on the Atlantic 
coast. A deep extensive low in the high latitudes moved eastward. 

The high pressure over the eastern Pacific pushed nearly northward. 

On the northwest side of the high pressure a low pressure moved north- 
eastward as it deepened rather quickly. Both models did not predict 
these developments satisfactorily. 

The intensity of the East Coast cyclone is accurately predicted 
by both models, but the forecast center position is far inland, and the 
PE forecast is slightly worse. The movement of the high-latitude low 
is well predicted by both models, but false intensification is apparent 
and strong in both model predictions. Again, the PE prediction is 
slightly worse. The deepening of the Pacific low is not predicted by 
either model, and in this respect our model makes a poorer prediction. 

In both model predictions the movements of the low are too slow. 

The northward movement of the eastern Pacific high is well pre- 
dicted by both models; the predicted center pressures, however, are 
much too high, and the PE forecast appears worse. Our model's pre- 
diction of the movement of the high pressure system over the Central 
part of the United States is much too slow, and the predicted center 
pressure is again much too high. The PE model prediction is even worse. 
Over the western part of the United States, both model predictions are 
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disastrous. In general, the overall sea-level pressure gradients in 
Figures 9b and 9d are obviously stronger than in Figure 9c. 

Figure 10 shows: (a) the initial 500-n* geopotential 

height distribution at OOZ January 1, 1975, (b) the 24-hour 
forecast by our model, (O the observed distribution at OOZ 
January 2, 1975, and (d) the 24-hour forecast by the three-level, 
frictionless and adiabatic version of the GISS model. It is 
clear that the predicted movements of the low troughs and high 
ridges are too slow in both models. 

Both models failed in predicting the following important 
developments: (1) the developing of a ridge over the central 

part of the United States, (2) the relative decrease in height 
over the Rocky Mountains, and (3) the developing of a shallow 
trough along 155 W. 

The next test case we discuss started with the initial 
conditions at OOZ January 2, 1975. The initial sea-level pressure 
and 500-mb geopotential height fields are shown in Figures 9c and 
IOC, respectively. Figure 11 shows: (a) the 24-hour forecast of sea- 

level pressure for OOZ January 3, 1975, made by our three-level model, 

(b) the observed sea- level pressure at OOZ January 3, (c) and id) the 

34-hour forecasts of sea-level pressure made by the three- and nine- 
level frictionless adiabatic versions of the GISS PE model, respective- 
ly. Clearly, all model predictions of sea-level pressure have much 
stronger gradients than the observed. This must be due to the exclusion 
of friction and nonadiabatic heating, since the skill of the nine- level 
GISS PE model (with friction and non-adiabatic heating included) has 
been well demonstrated (Somerville, et_aK, 1974: Druyan, 1974). It 
is quite surprising that the sea-level pressure forecast by our 
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three-level model (Fig. 11a) is as accurate as the forecast by the 
nine-level no-forcing version of the GISS model (Fig. lid) , and 
even somewhat better than it. The skill of the three-level PE 
forecast (Fig. 11c) is obviously the worst. 

The forecasts of 500-mb geopotential height made by the 
three models and the observed height distribution at OOZ January 3, 
1975, are shown in Fig. 12. The forecast by our three-level model 
(Fig. 12a) looks almost like a copy of the nine-level PE model 
(Fig.l2d) . Both forecasts miss the closed isolines over the Gulf 
of St. Lawrence and the Gulf of Mexico. The predicted trough over 
Nebraska is weaker, and the predicted low over Greenland is deeper 
than the corresponding observed features in both forecasts. There 
is no observed trough or ridge over the northeast Pacific like there is 
both forecasts. Clearly, the forecast by the three-level PE model 
is again much worse than the forecast by our three-level model. 

The third test case we discuss started with initial 
conditions at OOZ August 18, 1975. Fig. 13 shows: (a) the 

initial sea-level pressure, (b) the 24-hour forecast by our 
model, and (c) the observed sea- level pressure at OOZ August 19, 

19755. During this 24-hour period the observed features of the 
circulation developed as follows : the Arctic high pressure moved 

eastward; the pressure systems over the northeastern Pacific 
were stationary, while the Aleutian low deepened slightly; 
the pressure systems over North America were also stationary, 
but the low pressure near the Rocky Mountains deepened; the low 
pressure over the Atlantic moved slowly northeastward; the high 


3-67 


center behind it was about to combine with the Atlantic high. 

All these features are predicted quite well, except that the 
predicted Atlantic low moved slower and the low pressure, which 
was originally centered near the Rocky Mountains, was predicted 
to shift into a wrong position. 

Fig. 14 shows; (a) the initial 500-mb geopotential height 
distribution, (b) the 24-hour forecast by the model, and (c) the 
observed distribution at OOZ August 19, 1975. The intensity of the 
centers and the positions of the troughs and ridges are well 
predicted, except that the predicted geopotential heights over 
the east Atlantic near the African coast are too high. The 
computed skill scores and rms errors (Table 22) also indicate 
good agreement between forecast values and observed values. 

The last test case was started with initial conditions at OOZ 
August 19, 1975; the initial sea-level pressure and the 500-mb 
geopotential arc shown in Figures 13c and 14c. Figures 15a and 15b 
show the 24-hour forecasts of sea-level pressure and 500-mb 
geopotential height, respectively. Figures 15c ai}-J 15d show 
the observed sea-level pressure and the 500-mb geopotential 
height at OOZ August 20, 1975, respectively. During the 
24-hour period, the center of the eastern Pacific high moved 
northeastward. The Aleutian low weakened. The Arctic high 
moved eastward and weakened. The low pressure over the western 


3-68 


part of the United States was alm<//st stationary, but weakened. 

The cyclone over the eastern part hf Canada moved eastward to 
the sea and intensified. The high pressures over the east and 
west Atlantic combined into one with greater intensity. The 
Atlantic low moved northeastward and intensified. These features 
are rather well predicted by the model, except that the weakening 
of the low pressure over the western part of the Untied States is 
not predicted and that the predicted center position of the low 
is incorrect. The positions and intensities of the 500-mb 
lows, troughs and ridges are also predicted rather well. However, 
the predicted geopotential heights over the region southwest from 
the west coast of the United States are slightly higher, and the 

predicted gradients along the Atlantic trough are somewhat stronger 
than the observed. 

It has been mentioned in the above discussion that the 
pressure systems of the 24-hour forecast in the January cases 
are too strong. In the August cases, the same kind of error 
becomes apparent in the 48-hour forecasts. Figures 16a and 16c 
show the 48-hour forecasts of sea-level pressure and 500-mb 
height (24 hours after Figures 15a and 15b), respectively. As 
compared with the corresponding plots of observed quantities 

(Figures 16b and 16d), the false intensifications are clearly seen. 
We expect, according to our experience with the PE model, that the 
over-predicted pressure gradients will disappear or be largely 
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reduced whe^ frictional dissipation and nonadiabatic heating and 
cooling are included in the model in an adequate form. When these 
physical . mechanisms are included in the model, it will be meaningful 
to test the model further beyond one day. 

3. 2. 6. 1.5 Summary and Concluding Remarks 

A multi-level balance-equation model of the global atmosphere 

p 

is developed in a spherical* sigma coordinate system. The model 
equations are the vorticity equation, the balance equation, and 
the laws of conservation of thermal energy, of mass and of moisture. 
An iterative numerical method is used for the time integration 
of this highly impiici^' system of equations. Some test forecasts 

have been made with a/three-level adiabatic and frictionless ver- 

' ' / . . 0 . 

sion of the model , u4ing a latitude-longitude grid with 4 spacing 

in latitude and 5° in longitude. Global objective analyses made 
available by the National Meteorological Center, NOAA, were used 
to obtain the initial conditions and also to verify the forecasts. 
Some forecast examples are shown and compared with predictions by 
two versions of a primitive-equation (PE) model. 

The results demonstrate: (a) that it is feasible to construct 
a global filtered model on the. basis of the balance equations, 

(b) that a limited number of forecasts made with such a model 
compare favorably to forecasts made with an analogous version of 
a PE model, and (c) that, even for short-range weather predictions, 
the complete success of a balance equation model will depend 
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Fig. 9a. Initial sea-level 
pressure {mb-1000) , valid 
0000 GUT 1 January 1975. 


ORIGE^IAL PAGE IS 
OF POOR QUALITY 


Fig. 9b. The 24-hr forecast 
sea-level pressure (mb-lOOO) 
by 3-level PF model, valid 
0000 G^rr 2 January 1975. 


Fig. 9c. The observed sca 
level nrosfsure {inb-1000) 
valid 0000 GMT 2 January 
1975. 


Fig. 9'i. The 24-hr forecast 
sea-level pressure (mb-1000) 
by 3-level PE itr>del, valid 
0000 GMT 2 January 1975. 





Fig. 10a. Initial 500mb 
heights (lOOr) , valid 
0000 Gfr 1 January 1975. 



Fig. 10b. The 24-hr fore- 
cast by 3-level BE model, 
SOOmb heights (lOOm) , valid 
0000 GMT 2 January 1975. 







Fig. lOd. rne 24-hr fore- 
cast 500mb heights (100m) 
by 3-level °E model, valid 
0000 G!?r 2 January 1975. 
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?ig. 11a. The 24-hr fore- 
caat sea*'level pressure 
(r.)b-1000) by o -level BE 
n»del, valid 0000 GMT 
3 January* 1975. 



f^RIGINAL PAGE IS 

IHXJR quality 


Pig. 11b. The observed 
sea-level pressure (mb-1000) , 
valid 0000 GMT 3 January 
1975. 



Pig. 11c. The 24-hr fore- 
cast sea-level oressure 
(tnb-1000) by 3-level PE 
model, valid 0000 GMT 
3 January' 1975. 



Fig. lid. The 24-hr fore- 
cast sea— level pressure 
(mb-1000) by level tB model, 
valid 0000 Gff? 3 January 1975 
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Fig. 12a. The 24-hr fore- 
cast SOOtnb heights (100m) 
by 3-level BE model, valid 
0000 GMT 3 January 1975. 





Fig. 12d. The 24-hr fore- 
cast SOOnb heights (100m) by 
9-level PE mivVl, valid 0000 
GtIT 3 January 1975. 









Fig. 13a. Initial sea- 
level pressure (mb-1000) , 
valid 0000 GMT 18 
August 1975. 


ORIGINAL PAGL 
OF POOR quality 


Fig. 13b. The 24-hr 
forecast sea-level 
pressure (mb-1000) b< 
3-lovel BE model, valid 
0000 Girr 19 August 1975. 


Fig. 13c. The observed 
sea -level pressure 
( Tb-1000) , valid 0000 
GJIT 19 August 1975. 







Fig. 14a. Initial 500mb 
heights (100m) , valid 
0000 GMT 18 August 1975. 


Fig. 14b. The 24-hr 
forecast 500mb heights 
(100m) by 3-level BE 
model, valid 0000 GMT 
August 1975. 


Fig. 14c. The observed 
500mb heights (100m) , 
valid 0000 GMT 19 August 
197-- . 
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Fig. 15a. The 24-hr fore- 
cast sea-level pressure 
(mb-1000) by 3-level BE 
model, valid 0000 GMT 
20 August 1975. 


ORIGINAL PAGE IS 
OR POOR QUALITY 


Fig. 15b. The 24-hr forecast 
‘ioOmb heights (100m) by 3- 
level BE model . 



Fi.g. 15c. The observed sea- 
level pressure (’nb-1000) , 
valid 0000 GMT 20 August 1975. 



Fig. 15J. The observed 500mb 
heights (100m) , valid 0000 
20 August 1975. 
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Fig, 16a. The Aj!-hr fore- 
cast sea-level pressure 
(nb-1000) by 3-ievel BE 
model, valid 0000 GMT 
21 August 1975. 


Fig. 161). The observed 
sea-level pressure (mb-1000) , 
valid 0000 GOT 21 August 
1975. 


Fig. 16c. The 4B-hr fore- 
cast 500nb heights (lOOn) bv 
3-lf>vel RE model, valid 0000 
G:?T 21 August 1975. 


I 


‘ 16d. The observed 
500:*b heights (100m) valid 
0000 Girj.’ 21 August 1975. 


! 

i 




crucially upon the careful parameterization of the diabatic heating 
(or cooling) and frictional dissipation processes. One must 
realize that the task of parameterizing various subscale forcing 
processes in a balanced equation model is even more difficult than 
the corresponding task in a PE model: in addition to all the para- 

meterization difficulties confronting us in a PE model, we must succes- 
sfully parameterize the dispersive effect of gravity waves on heat and 
momentum transports, particularly when the forcing on any scale 
exceeds the bound that limits the validity of the balance equations. 

Besides the task of including forcing in the balance equation 
model more work needs to be done in order to make the method of 
solution more efficient and to improve the model in the region 
of steep mountains where forecast errors are generally larger. 

3. 2, 6. 2 Filtered Equations Method^ II j The Balance-Equation 
Model as A Data Assimilation Tool 

3. 2. 6.2.1 Introduction 

In Section 3. 2. 6.1 we described a balance-equation (BE) 
model. One of the main reasons for developing this model was to 
eventually use it as a data assimilation tool. In this section 
we describe some preliminary tests of using the BE model to help 
assimilate satellite-derived temperature data, in combination with 
the GISS 9-level primitive-equation (PE) model. 


3-79 




The nine-level version of the balance-equation ™odel is 
still too time consumin, and needs further evaluation and rm- 
provement. Hence, a successful test of uslnq it exclusrvely 
to carry out data assimilation was not deemed useful at thrs, 
staqe. instead, tests have been made to assess the potentra^ 

Of the BE model as a partial-balancing devxce xn PE-mo e 

assimilation. 

3. 2 . 6 . 2. 2 The Method 

The basic idea of partial balancin, can easily be described 

as follows. Define an atmospheric function, F, by 

P(*,*,T,r) 5 F • (7t + oa M 1<1 + ^^.i) 

+ ; 

in the a-coordinate system, is 
here V is the gradient operator xn the a c 

the stream function defined by = -(-Y), and the other 

notations are conventional. Denote the local value of r y 

SO that \ 




( 2 . 2 ) 


this reduces to the well-Known b^ equation in the o-coordinate 

. t,_a. '<>vip>Te exists inertial 

system for R = 0. For nonzero R, we say 

^ , Tra naQ#» of four-dxmen- 

qraviStional imbalance in the atmosphere. 

• -LUon excessive imbalance is 9cnerated 

sional (4-D) data assimilation, excessi 

esimee t <566 for instance , Appendxx 

as a result of the updatxng process. (See, 
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B.) Therefore, it is desirable at a certain stage of the assim- 
ilation to reduce the imbalance artificially, i.e., to find 
corrections AiJ», A$, AT and Air such that 

F(ii) + Aiji, + A$, T + AT, ir + Air) = (l-a)R 

or, 

F(if/ + Alp, $ + A<I>, T + AT, IT + Ait) - F(ip,'I',T,tT) =-aF(ip,$,T,TT) , 

where 0 < a < 1, and a may be a function of space and time if 
desired. One way to find such increments is the following: 
regard the increments in the above equation as temporal changes, 
and substitute the above equation, instead of the balance equa- 
tion proper, in the BE model; then solve for the required incre- 
ments by integrating the model forward and backward about the 
current time t. 

In the experiments we describe herein, the above partial- 
balancing procedure (PBP) was applied intermittently every 12 
hours during the assimilation process. The total reduction of 
imbalance in each application of the procedure depends upon the 
number (ISTEP) of forward and backward time steps performed, 
on the length of the time interval (At) used, and on the number 
of iterations (ITER) in each time step, since the balance-equation 
model uses an iterative method for time integration. 
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3. 2. 6. 2. 3 Preliminary Results 

Nineteen assimilation experiments were run with DST-5 data, 
starting from OOZ August 18, 1975, and using different values 

of the parameters ISTEP, ITER and At, as well as different smoothing 
procedures when necessary. We were interested in the impact of 

the above-described PBP on the accuracy of forecasts started 
from initial conditions obtained with the aid of PBP . A number 
of 72- to 84-hour forecasts were made from such initial conditions 
with the GISS PE model. These forecasts were then compared with 
the corresponding forecasts of control experiments which were 
started from initial conditions obtained by using the same data 
assimilated by the direct insertion method, with geostrophic wind 
corrections (DIM, Subsection 3.2.1). skill score and rms 

errors were computed for each forecast against the corresponding 
NMC objective analyses. Both the computed skill scores and rms 
errors seem to indicate that forecasts/ made from initial conditions 
assimilated with the aid of the PBP have generally no better skill 
than of forecasts made from the control initial conditions. Two 
typical examples are given below. 

Table 23 shows the evaluation, over North America, of forecast 
run 7937 in which the initial conditions were taken from assimila- 
tion experiment 7936 after a two-day assimilation. In experiment 
7936, ISTEP in each application of PBP is 2, i.e., marching forward 
and backward once, while At = 10 min., and ITER = 6; the local time 
derivatives of $, T and tt , as well as x and a were smoothed 
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Table 23. The RMS errors and skill scores (Sj^) over North America 
of the forecast run 7937, as compared with the control 
forecast 7819. (In parentheses is the difference be- 
tween the two forecasts. Positive sign means worse, 
negative sign means better.) 





Elapsed Time (hrs 

.) 


r^i^nmimwiBw mu j_ 


12 

24 

36 

48 

60 

72 

Sea- 

level 

^ 3 , 

42.4 

(+.5) 

49.4 
( + .4) 

68.0 
( + .5) 

81.8 

(+2.6) 

96.2 

(+3.6) 

98.6 

(+4.2) 

pressure 

rms 

(mb) 

1.57 

(-.30) 

2.07 

(-.02) 

3.04 

(+.19) 

3.97 

(+.21) 

5. 64 
(+.43) 

6.67 

(+.63) 

500 mb 
heights 

(%) 

25.8 

(+.7) 

30.5 

(-.6) 

33.6 

(+1.0) 

41.5 

(+1.0) 

47.9 

(-.6) 

54.5 

(-1.8) 


rms 

(m). 

18.2 

(+.9) 

22.1 

(-.5) 

27.0 

(+3.9) 

33.6 

(+2.9) 

42.3 

(+1.4) 

58.0 

(+.2) 


Table 24. The l^iS and skill scores (S^ ) over North Americ«.j of the 

forecast run 7927, as compared with the control forecast 
7819. (In parentheses is the difference betv.’een the two 
forecasts. Positive sign means worse, negative sign 
means better.) 





Elapsed Time (hrs. 

) 




12 

24 

36 

48 

60 

72 

Sea- 

level 


49.2 

(+7.3) 

52.6 

(+3.6) 

69.0 

(+1.5) 

76.8 

(-2.4) 

90.2 

(-2.4) 

89.5 

(-4.9) 

pressure 

rms 

(mb) 

2.43 

(+.48) 

2.21 

(+.12) 

3. 36 
(+.51) 

4.10 

(+.34) 

5.38 

(+.17) 

58.5 

(-1.0) 

500 mb 

%) 

35.0 

(+9.9) 

37.1 

(+6.0) 

36.5 

(+3.9) 

4.17 

(+1.2) 

47.0 

(-.5) 

51.6 

(-4.7) 

heights 

rms 

(m) 

27.6 

(+10.3) 

31.5 

(+8.9) 

36.3 45.8 

(+3.2) (+15.1) 

44.6 

(+3.7) 

58.4 

(+.6) 
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!ure centers at 002 August 21 ,■« 

as compared with actull analysif? e^cperiments 



horizontally in each iteration by a 5-point averaging formula with 
equal weights for all points, including the center point. Table 23 
indicates that forecast 7937 seems slightly better than the 
forecast of the control experiment 7819 at 24 h, but slightly 
worse thereafter. The slight skill improvement relative to the 
control in the 24-hour forecast is, however, not synoptically 
significant. Figure 17 shows a comparison of the forecast sea- 
level pressure centers plotted with their inner closed isobars . 

Table 24 shows the evaluation, over North America, of 
forecast run 7927 in which the initial conditions were taken 
from assimilation experiment 7926 after a two-day assimilation. 

In 7926, ISTEP =2, At = 30 min., ITER = 4, and whenever the 
iterative method exhibited an instability, the temperature and 
vorticity fields were smoothed horizontally using a 5-point 
averaging formula with the center point weighted by 4, and the 
other four points weighted by 1. Table 24 reveals that the 
forecast skill of run 7927 is worse than that of control run 7819. 
After 60 hours the skill scores of 7927 show some improvement 
compared with those of 7819, but this statistical improvement 
has no synoptic significance at all. The sea-level pressure (SLP) 
fields for forecasts started from 03Z August 20 both in experiment 
7927 and in experiment 7819,“as~ v;ell as the actual SLP analysis 
for' 30Z August 23 are plotted in Figures 18 through 20, respective- 
ly. It is very clear that both forecasts miss completely the low 
pressure syste, centered near (50“N, 80“W) , and the secondary low 
center close to Nova Scotia. The forecast fields for experiment 

■'i 

7927 are no better than those for control run 7319, except that the 
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number of very small eddies are reduced. Furthermore, forecast 7927 
weakens the two maritime semi-stationary high pressure centers in 
the verification region by a 4 mb more than the control forecast. 

The above two examples indicate that, relatively speaking, 
the assimilation which averages horizontally the local time deri- 
vatives in each iteration is better than the assimilation which 
smoothes the temperature and vortioity fields themselves. There 

is an excess of smoothing in either case. It may be possible to find 
ways to reduce the excess smoothing. 


3. 2. 6. 2.^ Concluding Remarks 


The results of the experiments tend to indicate that the 
partial-balancing procedure described above does not provide a 
significant Improvement in data assimilation over the straight 
forward procedure used for the control case. We note, however, 

(a) that all the assimilation experiments were carried out 
only for a short period - mostly 2 days, and 

(b) that during the assimilation period, most of the synoptic 
systems were semi-stationary and rather weak (see Figure 21). 

Under these unfavorable circumstances, one hardly expects 
much benefit from assimilation, since all the experiments were 
done Within this single unfavorable period, it is proper to say 
that the test is inconclusive. 
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Figure 21. The Intensities and Trajectories of Se 
Pressure Centers During the Period of 
Assimilation Experiments. 
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3 . 2.7 Statistical Assimilation Method (m. chii, r. oiiiing and 

H. Car us) 

3 . 2 . 7 . 1 Introduction 

It is well known that observational systems do not provide 
values of the atmospheric variables which are entirely exact and 
accurate at any given time. Numerical weather prediction models 
attempt to give as close an approximation to future states of the 
atmosphere as possible, say 2 to 5 days in advance. For an accurate 
approximation of future values to be possible, it is necessary to 
start the prediction with the best possible approximation of the 
meteorological variables at the present, i.e., at the initial time 
of a numerical forecast. 

In principle, information from observations at some initial 
time should be Sufficient, at least in quantity if not in quality 
to determine the complete initial atmospheric state at that time. 

In practice, the observational network is not sufficiently dense 
and uniform to provide the amount of information needed, in particu- 
lar, over large areas on the surface of the earth, observational 
data are completely missing at synoptic times (OOZ and 12Z) . 

It IS natural therefore to attempt to fill the void and include 
in the specification of an initial state, in addition to observations 
at the initial time, information provided from a model forecast, as 
well as by the available observations, before initial time. The 
forecast model, of course, provides information based on a previous 
initial state, and hence also on observations at previous times. 
Furthermore, it should be possible to improve the approximation of 
the initial state by utilizing a priori information on the cumulative 
statistical st ructure of both model errors and observational errors. 


The idea of using cumulative statistical information about 
observational errors in order to compensate for the deficiencies 
in the amount and accuracy of the observations at a given synoptic 
time was proposed by Eliassen (1954) . Gandin (1963) applied ex- 
tensively statistical methods to the objective analysis of conventional 
synoptic data . This approach to objective analysis has come to be 
known in the meteorological literature as " optimal interp olation. 

The inclusion of forecast information into the specification 
of an initial state by statistical methods leads to "optimal inter- 
polation" of the differences between observations and forecast values, 
rather than of the synoptic observations themselves. This approach 
has been advocated and implemented by Rutherford (1972, 1973). 

The application of statistical methods not only to the objective 
analysis of conventional synoptic observations, but also to the time- 
continuous assimilation of asynoptic satellite-derived data , was 
first carried out with SIRS data for a non-divergent barotropic model 
by Bengtsson and Gustavsson (1971, 1972). Our procedure of local 
"optimal interpolation" based on differences between satellite ob- 
servations and forecast values combines the above ideas for blending 
of satellite data in a time-continuous manner into assimilation runs 
of the GISS GCM. The statistically determined corrections are then 
added at each model time step of the assimilation cycle to the 
forecast values. We have been further encouraged in the vigorous 
pursuit of this particular approach by the conclusions of Phillips 
(1976) , to wit that only an explicit consideration of the statistical 
error structure of satellite temperature data will enhance their 
impact on numerical weather forecasts. 
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In Subsection 3. 2. 7. 2 the four-dimensional time -continuous 
statistical assimilation method (SAM) we developed is described. 

The application of the method to DST-5 and DST-6 data is described 
in Subsection 3.3.1 of the Results Section of this Chapter. The 
results of this method are then compared with those of the direct 
insertion (DIM) and asynoptic successive correction method (SCM) in 
Subsection 3.3.2. Finally, our conclusions concerning the effect 
of the assimilation method and of the quantity and quality of satel- 
lite data on forecast improvement are drawn in Section 3.4. 

3. 2. 7. 2 The FIethod 

The theoretical considerations in developing a statistical 
assimilation method are presented in any one of the references 
mentioned in the Introduction (Subsection 3. 2. 7.1). We shall not 
dwell upon them here and only present the actual procedure used 
in the numerical experiments we discuss in Section 3.3. 

The vertical temperature profiles obtained from satellite- 
based radiance measurements are grouped by 10-minute time intervals. 
This is the length of the time step At for the GISS GCM (see Chapter 
4), and there was no reason to use smaller groups of data. Certainly 
At is very short compared to the characteristic time scale of syn- 
optic motions (6-12h) and therefore the assimilation using such 
groups of data can be termed time -continuous in the context of 
global and of large-scale forecasts. A plot of a typical group of 
temperature data obtained in a 10-minute time interval is shown in 
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Figure 22. In the sequel we shall refer for the sake of brevity to 
satellite-derived temperatures as observed temperatures. 


The basic idea of the method is that these temperature data, 
which differ from the model forecast values at the same time and 
location, should be used in order to improve the estimate of the 
true atmospheric temperature in a neighborhood of the observations. The 
weight to be given to forecast values and to observed values in an 
averaging process is determined from previously available information on 
the error structure of both model forecasts and satellite observations. 


In the present implementation of the method, only information 
at the same mandatory pressure level is used, i.e., the "optimal 
interpolation" is two-dimensional. The formula used for the inter- 
polation Of forecast values from grid points to observation points 
is given in Subsection 3.2,4 (SCM) 


To simplify notation, we shall use a single subscript to 
indicate location, thus: k = (i,j), where i stands for discretized 
longitude and j for discretized latitude. Let k be an observation 
point (on a fixed mandatory pressure level), T° the observed tem- 
pCi-ature, and whs (interpolated) model temperature at the obser- 

vation point k. Let Yk be the difference between the observed and 
the forecast temperatures at k , 


Yk = 




( 1 ) 


we wish to compute corrections to forecast values at grid 
points I = (m,n) near the observation points k, where k ranges 
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Fig. 22. Domain of influence of satellite temperature retrievals in 10 min. time intervals. 
The T's stand for grid points in the immediate neighborhood of satellite retrievals, the +'8 
for points affected by the retrievals in the statistical assimilation method. 
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over a group, or "patch", of observations such as the one shown 
in Figure 22. In the figure, observation points k are marked by 
T's; grid points Ji which are affected by the observations after 
corrections are made appear as +'s. More precisely, after applying 
the corrections provided by our method, the temperature at + - points. 


as well as at T-points, will be different from the forecast value, i.e. , 


’■fi " * 


The corrections are computed by a linear formula. 




( 2 ) 


here and in the sequel we drop the vector notation for k and SL, 


the multi-index character of k and I being tacitly understood. 

' k 


The coefficients in Equation (2) are defined as the solutioJi 
of the system of linear equations 




(3) 


..N, 


where =(ai,...,ap, and N is the number of observation points 


in the patch. System (3) is the familiar normal system which arises 
in all statistical applications based on a least-squares approach. 


The statistical information accumulated on observations and 


I 


forecasts is incorporated into the entries the matrix and 


into the components of the right-hand side vector 3^. These 


are given by 


^kk ' ^ 


kk' 




(4a) 
(4 b) 
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here sj^j^, is the (spherical) distance between the two observation 
points k and k', and Sj^^ is the distance between the observation 
point k and the grid point i , at which we wish to make the 
correction. Notice that A depends on observation points only, and 
we can drop the subscript Jl, while depends on both observation 
points and the correction point we consider. 

The function (J) (s) is a correlation function . The fact that 
it depends only on the distance s reflects the assumptions of 
h omogeneity and of ig o tro p y we made at the outset concerning the 
error structure. We shall comment on the effect of these assump- 
tions and on related questions in Sections 3.3 and 3.4, as the 
occasion arises. 


A preliminary correlation function i|i(s-): was computed for DST-5 and 
for DST-6 separately, based in each case on all the pairs of differences 
(Yk' V,^.) available within the same DST period. The observations within 
the same interval At were considered as simultaneous and classified ac- 
cording to the distance s between them. Thus, letting t index the 
successive time intervals At, we have 


4'(s) = 


^T^Skki = s 


t2Yj(T)EYk. (T)l^ 


(5) 


here t runs over all the time intervals of At = 10 minutes within a 


DST period, and the sums in the denominator run over all the points, 
k as well as k', present in the pairs Yj^Yj^, of the numerator. Fur- 
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ther details on the computation of tjj(s) are given in Ghil et al . 
(1976a) for DST-5. The computation for DST-6 was entirely analogous. 
It is important to notice that the forecast values which enter into 
Equations (1) and (5) are based on 12-hour forecasts between synoptic 
times. The effect of forecast deterioration over 12 hours is not 
explicitly taken into account in the present implementation of the 
method any more than anisotropy is. 


The function (s) was computed for discrete values of s, 

s, = 100km, s„ = 300km,..., s = (2p-l ) xlOOkm. This means in 
JL ^ P 

particular that the sums in Equation (5) extend over (s ,+s )/2 
< s < (s +s ,)/2, rather than over s=s . The continuous function cj)(s) 

p p+1 p 

used in (4) was obtained in some cases from the discrete values 4'p='l^(Sp) 
by extending ijj(s) to the other values of s using linear interpolation. 


In fact the procedure was somewhat more complicated, and is described in 
detail in Subsection 3. 3. 1.2. In other cases we fitted an analytic 
function (() = (|>(s; Sq , c) , depending on the parameters So and c, to the 
values 4^p = '1^ (Sp) » ^ least-squares fit. In other words, we 

obtained the values of So and of c for which (j)(s;SoC) satisfied 


E [(|){s ;So,c)-ij; ] = minimum 

P P P 


( 6 ) 


Further details on the analytic expressions we used for (}) and on 
the determination of s„ and of c are given in Section 3.3 and in 
Appendix A. 

Having described the computation of the correlation function 
({)(s) in (4) , we return now to the algorithm given by Equations (1) 
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to (4) for obtaining the corrections 6.« It is clear that A is 

X» 7a 

determined exclusively by the geometry of an observation patch. 

But the weights a, depend on the correction point I, because 0^^ 
in Equation (3) does. This would seem to imply that for every 
correction point H we need to solve Equation (3) for the weights 
a ; such an approach would be computationally rather expensive. 

The number N of observation points in a patch is typically 50, so 
that a few thousand algebraic operations might be involved in making 

the correction at just one point. Fortunately, it is rather easy to 
circumvent this difficulty. 

Let Y = (Y f ••fYjj) stand for the vector of differences 
Combining Equations (2) and (3), the correction 6^ is given by 

«j, ‘ I = ' (7) 

T T 

( ) denotes the transpose of a vector or a matrix, x y is the 

inner or scalar product of the column vectors x and y, and A * is 

the inverse of the matrix A. The matrix A, however, is symmetric, 

a'^=A, since This allows us to write 

Equation (7) as 






( 8 ) 


where we used the rules for the transpose of a product and of an in- 
verse. Equation (8) makes it evident that we only need to compute 
the vector n = A~*y observation patch once; all the corrections 

6^ are then con >ited as inner products Thus, the total nvunber 
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of operations per patch is reduced to a few thousand, rather than a 
hundred times as much. Computer time estimates for the implementation 
of SAM will be given in Section 3.3. In the present version of the 
method, a general-purpose linear equation solver is used to solve the 
system 

the solver is based on Gaussian elimination with partial pivoting. 

This concludes the description of the method. We proceed with a 
description of the numerical experiments and their results in the next 
section. 

J 

3,3 RESULTS (M. chll, M. Halem and R. Billing) 

3.3.1 Description OF THE Experiments 
3. 3. 2. 2 Introduction 

The purpose of our experiments was to study the effect of satellite 
data on the quality of initial states obtained with the aid of such data, 
and on the accuracy of forecasts starting from such initial states. 
Specifically we studied the effect of the quantity and accuracy of the 
satellite data themselves on the one hand, and of the assimilation methods 
used to extract the information from the data, on the other. 

Experiments were carried out for the DST-5 (August 18 to September 
2) and DST-6 (January 29 to February 21) periods. The temperature data 
used were based on radiance measurements obtained from the VTPR instru- 
ment on board the NOAA-4 satellite and from the HIRS and SCAMS instru- 
ments on board the NIMBUS-6 satellite. We used in separate experiments 
temperature data derived from the measured radiances by the 
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processing methods developed by NESS (Smith and Woolf, 1976), as 
^grell as those derived by GISS (Chapter 2 of this Report) . 

All the experiments consisted basically of a continuous 
assimilation run , extending over the entire DST period, and of 
forecasts started from selected initial states produced by the 
assimilation run. The assimilation methods used for the satellite 
data were direct insertion (DIM, Subsection 3.2.1), asynoptic succes- 
sive correction (SCM, Subsection 3.2.4) , and time-continuous local 
statistical assimilation (SAM, Subsection 3,2.7). 

The assimilation run of every experiment was started at OOZ 
on the first day of the DST period (August 18 for DST-5 and January 

30 for DST-6) from an initial state given by a GISS objective anal- 

> 

ysis of conventional synoptic data available at that time (cf. Sub- 
section 3.2.1). At every model time step, i.e., every 10 minutes 
thereafter, corrections were made to the model temperatures, using 
satellite-derived temperature data which had become available during 
those 10 minutes. The assimilation method used determines the way 
in which the corrections were obtained from the data. In the control 
run, or NOSAT run, no temperature corrections were made at asynoptic 
times. In some runs, wind corrections based on a geostrophic formula 
(cf. Subsection 3.2.1) were also made at grid points where a temp- 
erature correction was made and at immediately adjacent grid points. 

The forecasts based on a given assimilation run were started at 
03Z on selected days during the DST period, beginning 2 days after the 
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start of the period, i.e. , August 20 for DST— 5 and February 1 for DST— 6. 
The reason to start the forecasts at 03Z and not at OOZ was to achieve 
as close a parallel as possible with operational practice at NMC, 
because NMC uses intermittent assimilation with a +3h "window" for 
satellite data. Thus, an operational NMC forecast started at OOZ uses 
all asynoptic information up to 03Z; so do our experimental runs 
started at 03Z as we rely on time-continuous assimilation. Starting 
3h after the insertion of asynoptic data also has the effect 

lotting the model smooth out the initialization shock occurring 
at synoptic time (see Appendix B> Ghil, 1975; and Ghil et a]^, 1977). 

Because of the short duration of the Impact Test Project, methods 
were still being developed while some experiments were carried out or 
had been completed. The summer experiments (DST-5J were carried 
out first, and more refined methods became available for 
the winter experiments (DST-6) . We expect to be able to perform 
in the near future on DST- 5 data some of the experiments we have 
carried out with DST-6 data. The only methods which have been ex- 
tensively tested, and on the results of which we report here, are 
direct insertion (DIM, Subsection 3.2.1), asynoptic successive correc- 
tion (SCM, Subsection 3.2.4), and statistical assimilation (SAM, Sub- 
section 3.2.7) . 

3. 3. 1,2 Summer Experiments 

A summary description of DST-5 experiments is given in Table 25, 

The number of parameters which influence the assimilation process is 
large, and the computational effort to carry out a full-length ex- 
periment for the entire DST period is considerable. Therefore, it 
was not possible to perform experiments for all the possible com- 
binations of parameter values. Even so, experiments were performed 
for a representative number of combinations . 
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The major parameters which were varied from experiment to ex- 
periment were; (1) the use of data from one or two satelli tes, (2) the 
use of temperature data processed by NESS methods or by GISS methods , 
and (3) the assimiXation method of the data. As we can see from 
the table, experiments were carried out with data from one satellite 
only, the NIMBUS-6, as well as with data from both NOAA-4 and NIMBUS-6 
with NESS-processed data as well as with GISS-processed data; with 
the methods of direct insertion (DIM) , successive corrections (SCM) , 
and statistical assimilation (SAM) . 

A few more comments are in order concerning details of the SAM 
experiraenvs . In two of them, Numbers 8119 and 8130, the correlation 
curve (|)(s) was not obtained by a least-squares fit of a two-parameter 
analytic function Sq, c) to the global data ij)(s) as described 

in Subsection 3. 2. 7. 2. At the time of preparation for these DST-5 
experiments, we considered separate data curves *()]^j;,(s) for different 
latitude bands k and mandatory pressure levels A, as described in 
Ghil et al . (1976a). The curve (|)(s) for these two experiments was 
then obtained by a least-squares fit of a piecewise-linear function 
to all the data curves ^ki(s) jointly; this least-squares fit is 
described in Ghil and Economedes (1976) . The reasons for using (j> 
of the form 

<j)(s; Sq, c) = (l-c)e"®/®o + c , (2.1) 

with certain non-zero values of c, will be discussed in the next 
Subsection, in connection with the winter experiments. The main 
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Table 25 . Sununary of DST-5 satelli 




Experiment 

No. 


7336 


7854 


7970 


8036 


8119 


8130 


8637 


8645 


8656 


8662 


8692 


8708 


VTPR 


Satellite Data 


NESS 


NIMB 


X 


X 


X 


GISS 


VTPR 


NIMB 


Assimilatii 

Method 


NO SAT 

DIM 

DIM 

SCM 

SAM 

SAM 

SAM 

SAM 

SAM 

SAM 

SAM 

NIMBUS and 
VTPR 
COMBINED 


VTPR thS instruiTK 

by NIMB^ Tht ^ ^ 

Z”!,- * processing method of the data 

™ v"’® Chapter as DIM, SCM or SAM, with^tl 

remarks concerning the method are explained^ 


)oard the NOAA-4 satellite 
.nstruments on board the NIj 
Lcated by the acronyms intr( 
:ol run appearing as NO SAT 
text. 












































reason has to do with the problem of the systematic warm bias in 

satellite-derived temperatures (Phillips, 1976; Tracton and McPherson, 
1977) . 

A first approach in attempting to deal with the bias problem 
consisted in simply computing the average difference between obser- 
vations and interpolated forecast values over a satellite-data 
"patch" (see Subsection 3. 2. 7. 2) at time t, 

Y(t) = ^ _ Y]^(t)/N^ , (2.2a) 

K"“l 

and multiplying it by a coefficient p; here N.^ is the number of 
observations at time t. The corrections are then made using 
the modified differences 

, 0<p<l; (2.2b) 

thus p = 0 means no modification of the procedure described in Sub- 
section 3.2.7. 2, while p = 1 means that Y' = 0. In practice only 
p = 0, p = 1 were used, and no experiments with intermediate values 

were carried out. An experiment with p = 1 is marked as "bias re- 
moved at observation point" in Table 25. 

Another straightforward attempt to deal with the bias problem, 
along the same lines as the first, was to "remove the bias at grid 
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points” (experiment Number 8662). In this approach, the weighted 


average S of the corrections is computed first, 

(A') 


6 = 




*1' 


^ £ liOl 


TPT 


(2.3a) 


V (fi-’’) . 

here a is the sum of the weights at correction point £”, 


N, 


/ p II \ ‘ 

« = 'k=i «r- 


(2.3b) 


(see Subsection 3. 2. 7. 2 for the definition of the weights a^) . 


The 


modified corrections are 




(2.3c) 


this modification is denoted as "bias removed at grid point" in 
Table 26 of the next Subsection with the remark that "bias at grid 
point is constant." It was not actually used for an experiment with 
DST-5 data. 


A slightly different form of the above modification was used in 
a summer experiment (Number 8662) , and is denoted in the same way in 
the "bias removal" column of Table 25. The remark it bears is "bias 
proportional to sum of weights." The formula for this modification is 


_ X „(A)t 


'I 


(2.4a) 


with is now defined as 


6 = 




(tT 


(2.4b) 
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The different curves 'j^j^jj(s) mentioned before (Ghil et al., 1976a; 
Ghil and Economedes, 1976) exhibited the striking property of a much 
faster decay at high latitudes than at lower latitudes; a function 

'^kiS,(s) attained any given threshold value e,0<e<l, faster, that is 
for smaller s, than the function whenever k^ corresponded 

to a higher latitude band than k 2 (for fixed level i, and in the same 
hemisphere) . This is in agreement with the well-known influence of 
latitude on the value of the Coriolis parameter, on the Rossby radius 
of deformation and hence on geostrophic adjustment. The dependence 
of curves on the level Z seemed much smaller and less systematic . 

The latitude dependence of the correlation functions for the ob- 
served-minus-forecast temperature field clearly points to the fact that 
the homogeneity assumption made at the beginning of Subsection 3. 2. 7. 2 
is not supported by the data. Without modifying the general form of 
the algorithm, described there, we decided to allow for latitude de- 
pendence by using instead of t()(s) described in Subsection 3. 2. 7. 2 and in 
Appendix A, a modified c()'(s;i,j), 

(J)'(s;i,j) = (t)(Sij)cos 0ij ; (2.5) 

here s=sj^j is still the spherical distance between points i and j, 
but depends on the latitude band in which those points lie. 

Further details are provided in Appendix A. 

The use of such a modified, or latitude-scaled correlation 
function has the added advantage that polar regions , over which the 
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earth-orbiting satellites pass more frequently, are not completely 
"swamped" by satellite-derived data which would cancel completely 
the stabilizing influence of model forecast values. This modifica- 
tion was used in all the SAM experiments of Table 25 starting with 
8637. 

A certain well-known difficulty in solving system (9) of 
Subsection 3. 2. 7. 2 arises from the fact that such a system appearing 
in s itistical computations is typically ill-conditioned , m other 

words, as the number N of observations y^ increases, the 

"weighted corrections" n become more and more sensitive to errors 
in the data, in A, as well as in y. 

Because of the ill-conditioning of this system, and in 
order to presmooth observational errors, the NESS-processed observatioj 
were first averaged to the GISS GCM grid points. This averaging was 
also performed in all SAM experiments in which the modified 4,'(s) 
was used. It had the additional advantage of further reducing com- 
putation time. In the future we plan to use for this purpose the 
more elaborate form of smoothing described in Subsection 3.2.3 (lip), 
instead of this simple averaging procedure, one further comment 
which is in order at this point is that after the statistical tem- 
perature corrections were carried out in experiments 8119 through 
8708, a geostrophic wind correction as mentioned in Subsection 3.2.1 


was also performed. This was also the case with the DIM and SCM 
experiments (7854 through 8036) . Experiment 8692 was not completed 
and we shall not dwell on the modification of SAM it contains. 

We turn now to the description of experiments performed with 
DST-6 data. 


3 . 3 . 1.3 Winter Experiments 

A summary description of DST-6 experiments is given in Table 
26. Most experiment descriptions in the Table are self-explanatory 
after referring back to the previous subsection. 

A latitude-scaled correlation function [cf.. Equation (2.5) 
above], averaging to GISS grid points, and geostrophic wind correc- 
tions were also used in all DST-6 SAM experiments, except 8497, 
where neither one of these modifications of the algorithm in Sub- 
section 3. 2. 7. 2 was used. Geostrophic wind correction was used in 
the DIM and SCM experiments (8210 through 8447) as well. 

Experiment 8497 did not necessitate averaging to GISS grid 
points, since the GISS processing of satellite radiances provides 
temperature profiles only at GISS grid points in the first place. 
The remark "RAG" for experiment 8497 refers to the acronym 
"retrieve as you go"; the meaning of this was that the radiance 
observations were processed concomitantly with the assimilation: 
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Table 26. Summary of DST-6 satellite-data assimilation experiments. 


Experiment 

No. 

Satellite Data | 

Assimilation i Correlation 

Method j Curve 

Bias 

Removed 


NESS 

GI 

ss 


— s/ s 

(l-c)e o + c 

at 

observa- 

tion 

1 



at 

grid point 
1 

VTPR 

■ 

■ 

■ 


s 

o 

(km) 

c 

7578 

■ 

■ 



NO SAT 





8240 

1 

H 

■1 


DIM 





8310 

X 

H 



SCM 





8352 


X 



SCM 





8405 


■ 



SCM 





8447 


X 

B 


SCM over land 


i 



1 

8472 


X 

■ 


SAM 

1831 

.018 

X 


8497 

m 



X 

RAG (DIM) 





8545 

■ 

X 



SAM 

1842 

.015 



8566 

m 

X 



SAM 

1842 

.015 

X 


8574 

m 

■ 



SAM 

2293 

-.124 

1 


8581 

X 

X 



SAM 


.015 

1 

X i 

X=Bias at grid 
Doint is constant 

8593 

X 

IH 

■1 


SAM 

1842 

.015 


X=Bias prop, to 
sum of weights 

8695 

J 




SAM 

1226 

.129 




•simulated NESS NIMBUS based on NO SAT 12-hour forecast 
••NIMBUS microwave (SCAJ4S) data only 

The same notation is used as in Table 25. In addition, the acronym RAG stands for 
Retrieve-as-you-go; this means that, in the GISS processing of satellite data, an updated tem- 
perature which uses previously assimilated information was employed as a first guess for the 
retrieval or derivation of a temperature profile from radiometric measurements. 
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Table 26. Summary of DST-6 satellite-data assimilation experiments. 


Experiment 

No. 

Satellite Data | 

Assimilation 

Method 

Correlation j Bias 

Curve 1 Removed 

. _ i 


NE 

ss 

GI 

SS 


(l-c)e + c 

at 

observa- 

tion 

at 

grid point 

VTPR 

NIMB 

VTPR 

NIMB 


s 

o 

(km) 

c 

7578 

1 




NO SAT 





8240 


X 



DIM 





8310 

X 

X 



SCM 





8352 


X 



SCM 





8405 


★ 



SCM 





8447 


X 



SCM over land 





8472 


X 

i 


SAM 

1831 

.018 

X 


j 

8497 



1 

X 

RAG (DIM) 





8545 

X 

X 



SAM 

1842 

.015 



8566 

X 

X 



SAM 

1842 

.015 

^ 


8574 

X 




SAM 

2293 

-.124 



8581 

X 

X 



SAM 

1842 

.015 

X 

X=Bias at grid 
Doint is constant 

8593 

X 

X 



SAM 

1842 

.015 


X=Bias prop, to 
sum of weights 

8695 

■1 



•k-k 

' SAM 

1226 

.129 




* simulated NESS NIMBUS based on NO SAT 12 -hour for-ecast 
**NIMBUS microwave (SCAMS) data only 

The same notation is used as in Table 25. In addition, the acronym RAG stands for 
Retrieve-as-you-go; this means that, in the GISS processing of satellite data, an updated tem- 
perature which uses previously assimilated information was employed as a first guess for the 
retrieval or derivation of a temperature profile from radiometric measurements. 



















the temperature processing, or retrieval, in the experiment was 
done using as a first guess the temperature at the previous time 

■V 

step of the assimilation process. Unfortunately the experiment is 
not complete at the time of this writing, and we shall not be able 
to report on its results. 


Experiment 8405 was set up as a control experiment to check 
the information content of satellite data, and to study the possible 
smoothing effect of SCM or SAM on variable values produced by as- 
similation runs. In it the temperature data used as "observations" 
were model values produced from a noSAT 12h-forecast, to which 
simulated observed-minus-forecast differences were added; these 
differences were computed at the true NIMBUS observation locations, 
by using a random- number generator function with the statistical 
properties determined from actual data. 


There only remains to discuss the form (2.1) (see Subsection 
3. 3. 1.2 above) of the correlation function (})(s). It was clear from 
the aspect of the latitude-and-height dependent curves (Ghil 

et , 1976a) , as well as from the aspect of the globally-averaged 
curve ij^(s) (Ghil et al . , 1976b) that an exponential would be best suited 
for an analytic function ^(s) which approximated well ijj(s). 

2 2 

Both normal functions exp(-s /s^ ) and simple exponentials 
exp(“s/s^) were tested. The simple exponential provided better 
least-squares fits to i|;(s) in all cases (summer or winter data, as 
well as data from one or two satellites). 
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was based 


The idea of using a second parameter c, besides Sq, 
on the following concept (Phillips, private communication, 1976) : 
Let X and y be random variables with mean x and y, respectively. 
They can be written then as 


x = x + C, y = y + h 


(3.1) 


where C and n are random variables with mean zero, f = n - 0, and with 
the same standard deviation as x and y respectively. The covariance 

of X and y is then. 


xy = xy + In 


(3.2) 


Now let X and y stand for and Yk* Subsection 3. 2. 7. 2. 

Assume that the satellite measurements have indeed a warm bias, i.e., 

13 - V = Y > 0- then the assumption of lack of correlation over large 

distances between observation-minus-forecast differences would result in 


Vk' 


> 0 , 


(3.3a) 


(Yj^-Y) (Yj^.-y) 


0 , 


(3.3b) 


as s 


kk’ 


Thus a warm bias would seem to imply a positive asymptotic 


—2 

value for (|)(s), and one should have c = y in (2.1). 


This idea was applied first to experiments with DST-6 data; 
from Table 26 we see that the values of c given by the best two- 
parameter least-squares fit were positive and small. A small negative 
value of c obtained for experiment 8574, which was actually performed 
later than most of the other winter experiments; large negative values 
of c obtained also for the DST-5 data when we attempted to apply 


this concept to them. The meaning of a negative c is not entirely 
clear (see, however, Gandin, 1963, Figs. 10 and 14; Phillips, 1976, 
Figs. 5 and 7); indeed, y<0 would still give a positive c = ^ 

careful study of the effect of very long waves on statistical 
structures of meteorological fields remains to be done. At this stage, 

functions *(s: s^, c) with o<0 were only used for reasons of con- 
sistency. 


in the experiments with data for which a least-squares fit of 
♦(s, So, c) = (l-o)e'®/®o + o yielded c / 0, we actually used a mod- 
ified 4 . (s), 4 ," = e with Sq provided by the two-parameter fit 

(So,c) . This was done in accordance with an attempt at removing the 
bias which seems somewhat more sophisticated than the ones described 
in the previous Subsection. 


Before proceeding to a presentation and discussion of results, 
we shall stop briefly to comment on the present status of computer 
implementation of the different methods. 

3. 3, 1.4 Computational Aspects of Experiments 

It is clear that more sophisticated assimilation methods require 
more computer time; it is important that improvements in results not 
be obtained at excessive cost. The discussion in this subsection, 
in conjunction with the results we present in 3.3.2, will show that 
the computer time necessary to implement the more successful ones 
among our methods is quite reasonable. 

The only additional computer time spent in applying our assimi- 
lation methods is in the assimilation run itself: forecasts require 
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the same time as if they were started from an initial state deter- 
mined by conventional synoptic analysis. The time to carry out a 
24h forecast is essentially the unit of time required to make the 
comparisons that follow and are independent/ to a certain extent/ 
computer installation; there will still be a certain depen- 
dence which comes from the ration of time spent in data transmission 
to and from peripheral equipment to that of computing time proper. 

®t other installations will also depend somewhat on the 
forecast model itself; this dependence can be eliminated by studying 
the number of arithmetic operations per 24h in each model/ and 
comparing it with the corresponding number for the GISS GCM. 

The timing estimates we give are for the present version of 
the GISS GCM (v. Chapter 4 ), the present status of our assimilation 
methods and for an Amdahl 470/6 computer with 2 megabytes of core. 

A 24h forecast runs in 40 minutes; a 24h NO SAT assimilation run/ 
in 48 minutes; a 24h SCM assimilation run in 58 minutes; and a 
24h SAM run in 96 minutes. 

The differences in time between the NO SAT assimilation and 
forecast is accounted for by the time necessary to make two 
synoptic analyses; this time is very short since the present GISS 
method of objective analysis is very simple (Subsection 3.2.1). We 
notice that the SCM assimilation requires only an amount of time 
which is negligibly larger than the NO SAT run. 

The time necessitated by the SAM method as measured here is only 
about 60 percent longer than that for SCM. We hope to reduce this 
time even further. The present length of time is d;ue to two factors. 
The first and most important is that the present version of SAM is 
still experimental: a number of diagnostic quantities are computed/ 
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ana printed which would not be required in an operational version 
of the code. The second vector is that the solution algorithm for 
system (9) of subsection 3.2. 7. 2 is very inefficient: it does not 
take advantage of the symmetry of A and of its relative sparsity. 

•S0 


We plan to implement a more efficient linear equation 
solver within the SAM method in the near future. We expect that 
an operational version of the code, without diagnostic quantities 
being computed and printed, will then run in a time much closer to 

that necessitated at present by SCM, say in not more than 75 minutes 
or 50 percent over a NO SAT run. 


/ 


Herewith the description of 


experiments performed with both 


DST-5 and DST-6 data is complete; we 
the results of these experiments. 


are ready to present and discuss 


3 . 3.2 Comparison of Results 
3 . 3 . 2.1 Introduction 

in this subsection we shall only discuss statistical measures 
of satellite-data Impact on forecast accuracy. A more detailed 
study Of the differences in initial states produced by the assim- 
ilation of satellite-derived temperature data, from a synoptic 
point of view, appears in Chapter 5, Evaluation and Verification 
Tests. Chapter 5 also contains a study of the effect of differences 
in the model -predicted large scale fields on local weather forecasts. 
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The statistical measures of Impact „e used were skill sco-es 
and root-mean-square (rms, differences. The meteorological fields 
we studied in particular were the sea-level pressure p, and the 
height * of the 500-mb gaopotential surface. First the difference 
between values of the field produced by a model forecast and the 
field values of the me objective analysis at the same synoptic time 
were computed. These differences were computed for the synoptic 
time 2 days and 3 days after the initial time of the forecast. They 
will be referred to in the sequel as differences at 48 h and 72 h 
after initial time, although they actually correspond to 45 h and 
69 h (see Subsection 3. 3. 1 . 1 ), respectively. 


The next step was to compute the rms value of the difference. 
The actual impact measure consisted in subtracting the rms 
difference for the control, or HO SAT, forecast from the rms dif- 
ference for the experimental forecast. A positive value of this 
difference then means positive impact of, or Improvement due to 
satellite data for the given experiment and quantity, while a nega- 
tive value means negative impact. The computations for skill score 
impacts were done in analogous fashion. To preserve the simple con- 
nection above between positive difference and positive impact, the 

Sj skiXX scores were defin'^d so ■(■ha-i- 

tnat higher score means poorer skiXX, 

i.e., zero corresponds to perfect skiXX and XOO to no skiXX. 


The verification regions over which the impact was measured 
were North America, or NA, and Europe, or EU. The verification 
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region labelled NA „as a latitude-longitude rectangle extending 
from 30«N to 70»N and 7S-W to 130-w, while EU extended from 30'N 
to 86"N and from 10“W to 40-E. These regions were selected because 
the operational NMC analyses for them are reliable, and because they 
are situated downstream from large areas over which conventional 
data coverage is sparse, i.e., the North Pacific and the North 
Atlantic basins respectively: moreover, being densely populated, 
the importance of good 2 to 3 day forecasts for these regions is 
particularly great. The downstream effect of good satellite data 
coverage over the ocean basins to the west of the verification areas 
should be noticeable at 48 to 72h after initial forecast time, 
provided (1) the forecast model is sufficiently skillful, (2) the 
asynoptic data are sufficiently accurate, and (3) their assimilation 
was done in a way which extracts the information from the data with- 
out harming model performance. 

3. 3. 2. 2 DST-5 Results 

Due to the very limited duration of the DST-5 period, forecasts 
were performed for every day of the period, starting with August 20, 
1975 at 03Z. Tables 27 through 34 present daily values of skill 
score impacts and rl rms impacts for p^ (SLP) and * (ZSOO), at 48h 
and 72h, over North America (NA) and Europe (ED): Tables 27a, 28a, 

29a, 30a, 31a, 32a, 33a, 34a give the impacts, while Tables 27b, 
29b, 30b, 31b, 32b, 33b, 34b give the oorrdspondlng RMS impacts. 
Experiments 7336 through 8130 were completed, experiments 8637 through 
8708 are still being performed (compare Table 25 of Subsection 3.3.1 
for a description of the experiments) . The columns labelled 8/20 
through 9/2 contain the results for the forecasts started on the 
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Table 27a. 

46 HP. =LP SXILL 6CCR5 

I>/PACT CN MCPTH 

APES 

;cA 







eXP 8/20 

3/21 

a /22 

c/23 e/24 

a/25 6/26 2/27 

3/2S 6/29 "6/30 

S/31 

9/1 9/2 

***»rtXP£S IMENT****** 
AVE SO SE 

*♦**0 IFF.FBCM17336} 
Ave sc S£ 

73311 V5.a 

79 . 1 

78. S 

69-8 64.4 

c3>3 67.6 65.4 

6 1.7 £6. 0 67-S 

73 .6 

83.1 68.4 

7 0 .74 

7 .03 

1 .8 8 

c.o 

C.C 

0. 0 

7634 1.2 

-3.0 

6.1 

7.1 - 1.6 

6.0 5.9 1.9 

3.S —0 -6 

5 .7 

2.6 -3.0 

60.93 

7.37 

1 .97 

1.76 

3-51 

0.94 

7970 2.0 

-1 .7 

7 .9 

,i.2 -3.4 

3.0 b.6 4.3 

4.5 —0. 3 1.3 

7.3 

5.9 -4.2 

63.01 

7.12 

1 .90 

2. 74 

3-96 

1.06 

£026 1.3 

0.9 

4 .6 

6-3 -C.7 

X .0 2.7 1.6 

1 . X 1.4 -1.1 

b . W 

-1.3 -3.2 

6 V .44 

7. 22 

1 .93 

1.31 

2.66 

0.71 

6119 6.7 

3.9 

6 .6 

2. 1 -6.0 

—3 .3 —2.0 —5.1 

2.6 -5.4 -0.7 

X .3 

-0.5 -a. a 

71 .42 

5.63 

1 .5 0 

-C. 63 

4. 85 

1.30 

ei 2 J 6.S 

0.6 

3.6 

7.4 -S.3 

— C.7 -0.3 -0.9 

5.2 -5.0 2.0 

1 .5 

9.1 -e.7 

69.76 

6.29 

1.68 

C.99 

5.85 

1.56 

66 37»»»»«. 


4 . 1 

— C.5»»4*» l.2*»»»* — 6.9***** 

5.3*»*** -5.7 

69.37 

4.68 

1 .77 

0.32 

£.01 

1.89 

CC.4S 

1 .0 

5.6 

6.9 —3.6 

— 1.9 2.0 1.5 

«»4** —5.0 -3.7 

6 .5 

3.2 -3.0 

69 .95 

5.31 

1 .53 

0.79 

4.23 

1.22 

6c 36 »*«*• 


11.5 


73.03 

7. S3 

3.77 

-5.63 

4.00 

2.00 

3662»«**» 

4 ma 


6.5*9 *4* 

— 2.0*4^»*>^ — 2.c»**«* — 

G.744444 -7.4 

70.37 

5.06 

1 .91 

-0.69 

£-02 

1.90 

£692»**»» 


5.. 7*«»* v 

0«2^^4(4«- 5.144474^ —4.9 ¥4 4444 44 44444 44444 

67.06 

6.72 

3.0 1 

1.66 

4.23 

1.92 

6 7C6*»^»»'» 

2 .3 «-« 

— 1 . 2** •• * 

4 .0 #«4 4 « 444«4 4 « 4444 44 4 444 4 4 4 4 44 4 444 4444 4444 

63 • 66 

8.67 

5.0 1 

1.37 

2.69 

1.55 
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Table 27 b. *e impact cp no«th pperic* 

e/27 e/2e e /29 s /30 e/21 

e.s 4«3 *-e 

1.1 e*« c.i -0.1 o «4 

0.6 c»i c. I e.2 0.2 

0«0 — C .4 0»2 - 0.0 0.0 

0.5 C.O 
t.l C.7 


9/1 9/2 

«.t 3*2 

- 0.2 - 0.1 
- 0 .» - 0.0 


EXP 

m 

s 

0 

8/21 

8/22 

8/23 e/ 2 * 

8/25 

8/26 

7336 

3.8 

5.6 

6.0 

5.6 4.1 

4 . 1 

2 ^ 

7654 

0*1 

- 0.4 

O.e 

0.8 — G.l 

-C.l 

1-3 

7970 

c.t 

- 0.2 

1.0 

0.7 -C .4 

- 0.6 

0.7 

e 036 

0.1 

O.t 

0.8 

O.e -C.O 

C .2 

0.0 

El 19 

0*6 

- 0.1 

- 0.0 

0*6 — 

C .4 

0.6 

£130 

C .3 

- 0.1 

1.2 

t «0 — C *6 

C.l 

0.3 

e 637 ***** 

0.2 


0 . 8 ***** 

- 0 . 2 ***** 

£ 6*5 

- 0.1 

- 0.0 

1.2 

1.1 -C .6 

-C.t 

0.6 





£662 


- 0.1 



— 0 . 2 ***** 
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£7C3««*«* -0.2***** 0.2***** -C.C***** 


— o.e***** — e« 7 ***** 0 . 2 ***** 

-O.C - 0.2 - 0.4 -C.4 O.S -».» 
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0.19 

C.29 

e.si 

0.14 

0.70 

0.19 

C. 17 

C.46 

0.12 

0.79 

0.21 

0.06 

e.39 

0.09 

0.83 

0.23 

C.15 

C.3S 

0.10 

0.96 

0.26 

C.22 

c.ei 

0.22 

1.34 

O.Sl 

-0.02 

0.57 

0.22 

0.77 

0.21 

0.01 

0.64 

0.17 

0.66 

0.33 

-C.S2 

0.52 

0.26 

1.56 

0.59 

-C.61 

1.C4 

0.39 

0.87 

0.33 

C.21 

0.42 

0.16 

0.91 

0.34 

C.03 

C.4S 

C.17 


—O.S —0.3 
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0.3 

- 0.2 
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77. HR. SCP SKILL SCORE INPACT CN NCRTH ANERICA 


*****EXPER IMENT****** *♦♦♦0 IFF . F ROM ( 7336 J 



EXP 

8/20 

a /21 

8/22 

a/ 23 a/24 

8/25 8/26 

a/27 e/23 

e/29 8/30 

8/ 31 9/1 9/2 

A VE 

SO 

5E 

AV£ 

£0 

SE 


7336 SA.l 

90.3 
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0.0 

O.C 
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T854 
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-0.3 5.0 

2.8 0.6 

4.2 -1.9 
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7.30 

1 .95 

2. 01 

4.57 

1.22 


7970 
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3.7 
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1.3 7.9 
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4.6 2.5 
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6.23 
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3.24 
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1.38 


3036 
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0.93 

U) 

1 
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-2.6 2.0 
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-0.08 

£.83 
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6130 

7.3 

10.6 

5 .5 

lO.a-1 1.5 

-S.9 -4.1 

4.1 -4.1 
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6.04 

1.74 
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\ 
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8. IS 
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Table 28b. 72 hr* slp rms impact ok ncpth America 
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0.2 

8656..*.* 

-O.I 



-0.1 





8662. ♦••• 


0.544*4* 


l.l*««4* -C.34444* 

-i .e***4* 

-0.2 

8692 



-0.14444* 



-0 .3****4 

0.0 

87C8 




c. 9**44* 



-0.1 


*****EXPERI8ENr •***•• 

sc se 

•••«OXFP 

4VE 

.F801* 173361 •••• 
SO SE 

5.59 

1 .01 

0.27 

C.O 

0.0 

0.0 

5.20 

0.93 

0.2S 

C.39 

0.82 

0.16 

5.30 

0.70 

0.19 

C.30 

0.57 

0.15 

5.42 

1.02 

0.27 

0.18 

0.42 

0.11 

5. S3 

0.99 

0.27 

C.17 

0.52 

0.14 

S.34 

0.71 

0.19 

C.2S 

C.8I 

0.16 

S.22 

1.08 

0.41 

0.37 

C.4S 

0.18 

5.47 

0.81 

0.22 

C. 13 

0.74 

0.20 

6.06 

0.92 

0.46 

0.10 

e.84 

0.42 

5. 45 

0.83 

0.31 

C.14 

1.00 

0.38 

S.3S 

0.74 

0.28 

C.24 

C.82 

0.24 

5.17 

0.69 

0.26 

0.42 

0.57 

0.22 


i 
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Table 29a. hr. zsoo skill sccbe inpaci on ncrth akehica 

♦ •♦EXPERIMENT ♦♦♦♦** ••••0IFF.FH0MI73351 ♦•*• 


EXP e /20 
7336 40.0 

8/21 

47.3 

8/22 

52.7 

8/23 a/24 
51 .5 54. 3 

e/25 8/26 
44.9 42.7 

8/27 8/28 8/29 8/30 
47.4 40.7 49.5 43. l' 

8/31 9/1 .9/2 

54.9 55.5 38.0 

Ave 

47.32 

SO 

5.91 

SE 

1.58 

AVE 

C.O 

£0 

O.C 

Sc 

0.0 

7B54 -1.0 

-1.9 

5.4 

6.0 - 1.3 

-4,4 

2.0 

0,8 0,3 -0.8 -1.6 

5.5 -3.8 -2.4 

47.12 

5.70 

1.52 

0.20 

3.38 

0. 90 

7970 0.2 

- 0.6 

5.1 

6.1 -3.2 

-2.3 

2.5 

3.0 -3.0 —1.2 -2.1 

6.8 0.1 -4.8 

46.85 

S. 08 

1.36 

0.47 

3.67 

0.93 

8036 — 0.6 

—0.1 

4.2 

6.4 -2.0 

0 .5 -1.5 

—3.1 -3.4 -0.3 -0.2 

2 .7 -2.2 -2.2 

47.45 

5.37 

1 .44 

-C.13 

2.62 

0. 75 

6119 -2*1 

-2.4 

7.2 

9.3 -1.7 

-1.7 

2.1 

O.U 2.8 -0.2 -0 .7 

7.2 -2.8-15.4 

47.00 

5.73 

1.33 

0.32 

£.58 

1.49 

6130 -2.9 

-0.9 

6.1 

9.5 -2.2 

“ : .4 —0.7 

2.2 l.i -1.7 -3.9 

6.4 1.6 -9.1 

47.03 

4.58 

1 .22 

0.29 

4.75 

1.27 

8o37***** 

-4.1**»** 

5.9«4*4* 

— t 

0.94««*« — 1.7***»* 

2.5***** —8.5 

48.59 

2.91 

1.10 

-C.95 

4.66 

1.76 

e646***** 

-3.2 

4«4 

6.7 2.3 

-0.3 

0.6 

1.54***4 —2.9 -1.8 

3.5 0.1 -7.8 

48.22 

4. 04 

1.17 

0.26 

3.83 

1.12 

86So*4*4* 

—4 

3.1*4*44 

- 3 . 4 -»**** 

— 4.0 4* 

49.86 

1 .74 

0.87 

-2.09 

3.48 

1.74 

6662***4* 

-1 *7*»*4* 

6.7***** 

- i s7**^** 

0.44«4«-» 

0 . !••••• —7.3 

48.48 

3.68 

1.39 

-C.84 

4.19 

1.58 

6692 •*4** 


7.5****V 

— 0 .444c«*« 

2«744«4i4 1 

46.95 

3. 17 

1 .42 

1.17 

4.06 

1.82 


S'fOS***-** — 2.S«*«** 5. !*•••• 2. &•••••«•*»•«**«•«••*••«•«•••* •••••••••«•• 46.1d 3.7S 2.l£ 1.74 3.41 2.26 
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Table 30a. 72 hr. 2500 skill score impact on north America 


EXP 

7335 

8/20 

51.9 

8/21 

57.3 

6/ 22 
62.6 

8/23 a /24 
59.8 53.9 

8/25 

45,7 

3/26 

54 .S 

a /27 8/28 
55.5 51,5 

e/29 

53.6 

8/30 

57.0 

8/21 9/1 9/2 

60.4 50.0 48.7 

765 -. 

- 1.5 

- 3.2 

4.6 

4 . 4 — 10.4 

-S.3 

3.6 

1.7 0.3 

- 1.0 

- 1.5 

4 .5 - 3.8 - 1.0 

7970 

2.2 

1.5 

1 .6 

3 . 9 - 10.3 

— 3.3 

4.2 

- 0.2 - 2.9 

0.2 

- 0.3 

4.8 - 4.1 - 2.7 

8036 

- 1.3 

1.5 

7.2 

6.8 - 1.3 

- 0.6 

0.3 

- 9.8 - 5.9 

-1.0 

7.5 

1 .4 - 3.2 - 0.4 

81 19 

0.7 

- 1.1 

9.9 

10.6 - 5.3 

-4.1 

1.0 

0.2 - 2.1 

0 . 1 

3.5 

7 .8 - 8 . 0 - 11.4 

8130 

-1.4 

3.1 

8 .6 

8 . 4 - 1 1.2 

- 2.8 

- 2.0 

- 2.9 - 3.4 

- 1.9 

4.9 

3 .8 - 4 . 4 - 12.0 

863704*** 

— 2.4**4«4 

2 . 8 ***** 

- 3 . 3 * 4 =*** 

- 3. 1 ***** 

- 5 . 6 *****= 

1 . 0 «*«*» — 6.4 

8645 **««* 

- 0.7 

6.6 

3.9 - 1 . 1 

- 4,4 

1 .5 

0 . 2 ***** 

-7.3 

2 .6 

1 .9 - 2.4 - 6. 1 


66S6***«* 2.6***** -2.2****4= -7. 9 4« ««*»**»«*******» *»««« 

e662***»* -0.5**#** 2.9****# -4,74**** -I.6444** -A. !**♦»» 0.7****4 -0.5 

C6S2»*»»* — I.O***** — i.l*A*** — -4, ^•♦**;**»!* 4*«t********* 

67Cfc***** 0.8*M4*« 2.64«*4>4> — 0 .2 A***^********^ A4 4*44««4»444* ««4 444444444 


♦****EXPERIMENT* 4444 * •**«aiFF.FRCM( 733 o) 
"VE SO SE AVE SO Se 


54 .46 

4.74 

1 .27 

0.0 

C.C 

0 . 0 

55.07 

4.11 

1.10 

-C .61 

4.29 

1.15 

54.34 

4.21 

1.13 

-C .39 

4 .CS 

1.08 

54.37 

4.60 

1 .23 

0.09 

4.84 

1.29 

54.33 

3.43 

0.92 

C .13 

6.38 

1.70 

55.40 

4.09 

1.09 

- 0.94 

6.24 

1.67 

56.35 

3.83 

1 .4 6 

- 2.42 

3.30 

1.25 

55.37 

2.87 

0.83 

-C .45 

4.13 

1.19 

56.44 

6.42 

3.21 

- 1.87 

4*49 

2.24 

55.57 

4.06 

1 .53 

-I, 14 

2.64 

1.00 

55.59 

3.94 

1 .76 

- 1.21 

3.20 

1.43 

53.16 

6.32 

3.65 

1.11 

1.42 

0.82 
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Table 30b, **"• «co bus impact cm noptm America 



EXP 

1336 

axio 

83.9 

8/21 

10.1 

8/22 

68.0 

e /23 e /24 e/ 2 S 
65 . e 61.0 49.1 

8/26 8/27 8/28 8/29 
IS.e 61.9 58.7 56.5 

8/3 0 
58.1 

8/31 9/1 9/2 

58.8 42.1 42.3 

94444 EXPERIMENT 4444 ** 

AVE SO SE 

Se .76 9.72 2 . 6 C 

****OIPF.PMOM( 733«»***4 

AVE SO SE 

0.0 C.C 0.0 



78 S 4 

- 1.9 

9.6 

1.8 

1.1 - 9.3 1.3 

23.4 15.6 3.9 - 0.3 

- 0.7 

1.4 - 7.4 — 3.4 

54.93 

6.65 

1.78 

3.83 

8.88 

2.37 



3-123 

1919 

8.2 

1.9 

9.3 

3 . 9 - 1 C .6 - 5.5 

15.4 6.5 - 3.5 - 0.7 

- 4.9 

5 . 5 — 10.7 — 1.4 

58 . A 5 

6.62 

1.77 

C .31 

7.79 

2.08 



a 036 

— 1.3 

4.2 

11.0 

12.6 — 1.4 1.1 

1 . 1 — 19 . 7 - 1 l.e - 6.8 

6.6 

0.2 - 4.6 - 2.3 

59.51 

10.81 

2.89 

- 0.75 

8.90 

2.27 



8119 

1*8 

- 1.2 

16.6 

18.0 - 5.4 - 2.8 

16.3 3.0 -C .3 - 3.8 

0.4 


57.29 

8.51 

1.81 

2.74 

9.99 

2.65 




8130 

1.5 

s.s 

12 .S 

12 . 8 - 11.9 -S.l 

13.6 1.3 - 7 . 4 - 41.8 

4.1 

2 . 5 - 15 . 0 - 13.5 

61.75 

12.01 

3.21 

- 2.99 

■ 4.79 

3.94 





— 5 . 5 ***«* 

8 . 7 *«***- 10 . 1 «* 44 * t 2 . 04 «** 4 - 13 . 4444*4 

0 , 24 * 444 - 14.3 

61.15 

8.72 

3.29 

- 3.28 

IC .60 

4.00 




8645 

- 0.3 

- 4.2 

13.2 

8.6 - 4.3 - 8.3 

10.0 9 . 3 - 12 . 7 - 13.6 

- 0.7 

2.2 - 1 . 6 - 14,5 

60.41 

7.62 

2.04 

- 1.69 

9.29 

2.48 

c 

S' 


e 6 S 6 ***A* — 1 . 4 S. «««•«• 
e662*»*4* -0.9***** 6.6*****-23.9«**»« 

e6924«««* — 1*3«*«*« B»3***** 

E7ca«***« -0.9«**«* 2.1**«*« 1.3*0«*4«4 


- 3 . 3 «•««•« 4 ••«•*• «••••*•••*•«•***« 

ia«a*«*** -s*94«*«* — Sw6 

9<8««**« — 7«t«4>4«* 10«9 

t2»S4*A«* — a.4*4**» 2«64*4**-2t«l 


68.20 

22.83 

11.42 

- 6.32 

16.78 

8.39 

61.49 

9.55 

3.61 

- 3.62 

11.17 

4.22 

99.27 

6.58 

2.49 

- 1.40 

e.it 

3.07 

97.80 

11.63 

4.39 

- 0.01 

1 * 1.93 

4.91 



t 
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Table 31a. 43 ns. slp skill 

scope IKPACT CM 

EUBCPE 







EXP 8/20 S/21 8/22 8/23 8/24 3/25 

8/26 

8/27 8/28 

8/29 

8/30 8/31 9/1 9/2 

♦***4eXPE«IMENT****** 

AWE SO SE 

**««OIFF.FPOMC7336)**** 

AWE SO sp 

7-326 73.4 b4.6 67 .6 66.2 66.6 6S.6 

Q2.5 

64.1 6C.0 

68.2 

66.5 55.0 61.3 70.3 

66.86 

6.45 

1 .72 

0.0 

C • C 

0.0 

7854 3.6 1.2 -0.2 -1.3 B. 8 5.3 

8.5 

-0.6 0.6 

1 .8 

3.4 —2.6 2.1 —0.9 

65.31 

4.69 

1 .25 

t.ss 

2.92 

0.73 

7S70 0.1 -l.O -2.2 -1.4 3.0 4.4 

5.9 

0.7 1.1 

2.0 

3.1 —1 .6 3.9 5.4 

65.19 

5.61 

I .50 

1.67 

2.69 

0.72 

8036 2.3 -2.1 1.5 -3.3 -1.5 -1.0 

5.2 

1.3 1.3 

3.9 

6.7 0.8 -0.2 0.2 

65.64 

6.09 

1 .63 

1.22 

2.99 

0.80 

6115 —2.1 —3. a 3.2 —6.6 — C.5 —1.0 

7.6 

-1.7 -6.9 

2. 0 

-0.6 -4.7 -5.8-11.3 

69.16 

5. 49 

1 .4 7 

-2.30 

4.77 

1.27 

8130 0.5 -l.C -1.6 -8.7 -4.1 8.3 

13.7 

-4.0-14.7 

-4.7 

-5.3 —2 .'a 3.0 -9.1 

69.04 

6.38 

1 .70 

-2. 18 

7.17 

1.92 

8637***** 2.844*** 1 .8**««« -1 .5**«*« 

2.0***** 

-2. 0***** -6.8***** -0.4 

66 .01 

4.43 

1.68 

-0.58 

3.31 

1.25 

8645***** 2.1 -2.5 -2.1 -l.S -4.4" 

3.7 

4.3 ***** 

-i.o’ 

0.2 -3.9 0.5 0.7 

67.24 

5.95 

1-72 

-0.35 

2.80 

0.81 

86S6***** — 0.3444** —6.6***** — 3.4***** 

S.7 ♦*♦***♦**#***•*♦** 

67.26' 

7.02 

3.51 

-1.14 

S.24 

2.62 

6662***** 1.64*7** 1.8***** — O.S«**«« 

—0.5***** 

—0.2***** -5.1***** 2.3 

6S.52 

3. St 

1.33 

-0,09 

2.48 

0.94 

8692*»*** 2.3***** 0.3***** -O.S***** 

0.7*«*«* 

-3. 1 ****** »* ******* *4**4 

66 .68 

4.06 

1 .81 

-0.14 

2.00 

0.89 

£70&-X^4t4<4i — 0«7****« — ""^ * ^^** ^ T 44^ 4 ^ 

70.45 

S.30 

3.06 

-3.6S 

2.80 

1.62 
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Table 31b. ♦* h«. slp rms impact on eurcpe 


EXP 

8X20 

8/21 

8/22 

8/23 

8/24 

8/25 

8/26 

8/27 

8/28 

8/29 

8/30 

8/31 

9/1 

9/2 

44444EXPERIMENT4444** 

AVE SO SE 

•4440IFP.FR0M17336) 

AVE £0 SE 

7334 

3.3 

5. 1 

4.0 

3*7 

S.5 

7.7 

6.7 

4.1 

3.2 

5.1 

6.8 

5.7 

3.6 

4.0 

4.89 

1.43 

0.38 

C.O 

0.0 

0.0 

7854 

0.0 

0.7 

0.6 

0.5 

0.9 

1.2 

0.8 

0.2 

C.9 

1.1 

1.1 

O.S 

0.6 

O.S 

4.20 

1.24 

0.33 

0.69 

0.35 

0. 09 

7970 

0.0 

0.6 

0.6 

0.4 

C.9 

C.9 

0.9 

0.6 

C.9 

0.5 

-0.0 

0.2 

0.5 

0.7 

4.34 

1.43 

0.38 

0.55 

C«31 

0.08 

8036 

0.1 

0.3 

0.6 

0.4 

0.3 

0.2 

0.7 

O.S 

C.l 

2.8 

0.9 

-0.2 

0.1 

0.3 

4.39 

I. SO 

0.40 

0.50 

0.73 

0.19 

01 19 

-0.4 

0.2 

-0.7 

0.4 

0.8 

1.2 

1.2 

0.6 

-C.7 

1.6 

0.5444*4 

-0.9*4444 

4.60 

1.08 

0.31 

0.30 

0.83 

0.24 

8130 

-0.9 

0.7 

-0.6 

0.0 

0.9 

1.7 

2.4 

0. 1 

-C.6 

1.9 

0.0 

2.3 

1.1 

-0.5 

4.28 

1 .08 

0.29 

0.61 

1.13 

0.30 





0.7 4 

>0000 

1.14 

f0000 

0.7* 

'**4* 

-0.0 

5.18 

1.91 

0.72 

-0.12 

0.98 

0.37 

8645 

-0.5 

-0.3 

0.2 

-0.5 

C.4 

-0.6 

0.0 

0.7 

C.3 

1.4 

0.9 

1 .0 

0.2 

0.4 

4.64 

1.51 

0.40 

C.26 

0.61 

0.16 

8656 4 


0.34 



-1.944444 


5.38 

2.87 

1.44 

-0.23 

1.26 

0.63 

C662 4 


0.7 4 


-0.64 


-0.94 

0000 

0.34 



1.144444 

-0.5 

4.97 

1.61 

0.61 

0.09 

0.76 

0.29 



-1.144*44 

-0.7*44*4 




0.1 

5.16 

1.57 

0.59 

-0.10 

C.67 

0.25 

87C8«4*4* 







0.2 

4.84 

1.91 

0.72 

0.22 

0.94 

0.36 
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Table 32 a. 72 hh. slp csrou impact c^ euhope 

' *»***exPERIMENT **♦•♦» «**»01PF.FROM|7336) A»»* 


EXP 

e/20 

8721 

8/22 

8/23 8/24 

8/25 

8/26 8/27 

6/28 

8/29 

8/30 

8/31 9/1 

9/2 

AVE 

SC 

SE 

AVE 

SO 

SE 

7336 

7A«8 

/6.6 

77.6 

73.5 73.3102.0 

92.2 70.6 

8C.8 

71.0 

72.7 

67.2 74.5 

82.2 

7 7.79 

9.27 

2.4 8 

C.O 

0.0 

0. 0 

76 5A 

6.9 

3.0 

-2.7 

6.0 3.9 

1 1 .0 

10.4 -5.8 

2.1 

1.9 

-1.6 

-I .2 2.2 

3.2 

74.98 

6.73 

1 .80 

2.81 

4.76 

1.27 

7970 

1 .a 

-l.O 

-3.0 

6.1 5.8 

8 .9 

5.3 1.9 

0.7 

3.6 

- 2.3 

-3.1 8.9 

4.4 

75.07 

8. 17 

2.1 fi 

2. 71 

4.10 

1.10 

£036 

2.0 

-1.8 

3.9 

4.0 1.1 

6.0 

12.5 3.6 

£.9 

4.9 

6.0 

-4.8 -3.3 

2.1 

74.78 

7.71 

2.06 

3.01 

4.40 

1. 18 

81 19 

-3.7 

2.5 

1 .8 

2.6 — C. 4 

15.0 

0.4- 15.8 

12.4 

3.2 

-6.3 

-9 .2 -4.8-11.9 

73.80 

8.25 

2.20 

-1.02 

8.52 

2.28 

£130 

5.6 

5.6 

-3. A 

-3.5 -3.4 

17.9 

7.7-18.6 

0.0 

-6.3 

-8. 6 

-1 .6 -6.8 

-0.3 

78.91 

5.99 

1 .60 

-1.12 

8.63 

2.31 

6637««#«v 

2.9 ♦♦♦♦♦ 

7.3444** 

^0«54c4i*«* 4«7«*««« 

1.5***** 

-7 ,7*4*4* 

-0.8 

76.44 

12.97 

4.90 

1.14 

4.92 

1.86 

a645*^**4: 

4.1 

-5.3 

1 .8 -3. 3 

- 3.3 

3.5 1.6«***4 

-1.0 

-0.4 

—5.7 5.3 

0.5 

78.04 

10.52 

3.04 

-C.26 

3. 75 

1.08 

3656 

-0.3*44 *4 

-2.4*44*4 


81.42 

16.44 

8.22 

-C.74 

2.88 

1.44 

3662«««*« 

7.44*4*» 

7. 5***4* 

— — 2»a««4«4 

— l.7***4* 

-6 . 344 * 4 * 

1.6 

77.01 

12.62 

4.77 

C.S8 

5.21 

1.97 


3.24«!*4* 

4.2***«4 

- 2.1 



76.87 

14.31 

6.40 

-C.13 

3.79 

1.70 

£7 03 **<>«•«* 

-0.1 

*»« $«t 

2. 9 ** 44 * 

— 3 . 6 * 444 * 44 * 44 * 4 * 4 ** 44 * 44 * 44 ** 4 * «*44**4*4*4* 

84.31 

18.72 

10*81 

-0.27 

3.27 

1.89 
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Table 32b. 72 h«. «lp rms impact ca eywope 


exp 

8X20 

8X21 

8X22 

8X23 

8X24 

8X25 

8X26 

8X27 

8X28 

8X29 8XS0 

8X31 

9X1 

9X2 

AVE 

SO 

S£ 

AVE 

SO 

SE 

73.16 

4.9 

4.8 

4.2 

6.1 

7.6 

11.2 

8.3 

3.9 

5.7 

c.a 7.6 

4.6 

4.4 

S.4 

6.11 

2.02 

0.S4 

C.O 

C.O 

0.0 

7856 

C.7 

0.2 

0.2 

l«2 

s* s 

1.4 

1.0 

0.2 

€ «6 

1.2 0.2 

-O.S 

0.4 

0.4 

5.56 

1.74 

0.46 

O.SS 

C.SI 

0.14 

7970 

0.3 

0.4 

0.3 

1.2 

1.4 

1.8 

1.1 

0.9 

C.l 

-C.3 -0.3 

-0.1 

0.7 

0.3 

S.SS 

1.78 

0.48 

C.56 

0.64 

0.17 

8036 

-C.2 

0.1 

0.7 

0.3 

0.6 

1.2 

2.1 

0.8 

‘ 0.3 

0.9 0.6 

-0.2 

0.0 

0.7 

5.52 

1.71 

0.46 

0.60 

0.60 

0.16 

8119 

0.7 

-0 .0 

-0.3 

1.1 

1.7 

2.2 

2.0 

-0.4 

2.7 

1.6 -0.6*** *♦ 


5.43 

1.70 

0.49 

C.87 

1.18 

O.i* 

8130 

O.S 

0.8 

-1 .0 

0.6 

1.6 

3.C 

2.9 

-0.8 

2.4 

0.6 -1.4 

0.5 

-0.3 

0.2 

5.3? 

1 .46 

0.39 

0.74 

I.SO 

0.40 

8637« 


—0*8 

-0.3***** 

-1.0***** 

0.4*44** 

—0.5***** 

-1 .4****« 

0.4 

6.58 

2.72 

1.03 

-0.46 

0.68 

0.26 

8645 

-^.2 

0.2 

-0.4 

-0.9 

0.6 

-0.3 

0.9 

0.2 

0.6 

0.8 O.S 

-0.4 

O.S 

0.7 

S.92 

2.02 

0.54 

0.19 

0.84 

0.14 

e6S6«»*«« 

0.4 ***** 

-2.6**«** 

-1.4***** 


7.38 

4.10 

2.0S 

-8.88 

1.42 

0.71 

e662****4 


0.4***** 


0.5 < 


-0.2***** 

— 0«3**^** 

0.1 

5.93 

Xi2.S9 

0.98 

0.18 

0.35 

0.13 

8692 


-0.4***** 

-O.S***** 



0.1***** 


0.4 

6.47 

2.20 

0.83 

-C.3S 

0.56 

0.21 

87C8 

4*4*4 

.0.7***** 

-O.S*****-98.2***4* 

le7«*4** 

-0. !****• 

-0.1***** 

1.1 

S9.76 

• 

(II 

14.9A 

-13.64 

37.28 

14.09 
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Table 33 a 


exp ayzo 

733t> £7.3 

7854 7.7 

7970 4.6 

8036 £«4 

6119 £.0 

8130 4.3 

eo37*«*¥* 

6o£o • * • 

e 662 *»**-e 

£692»-*»»« 

£7C<J*»*»f 


a/ 2 l d /22 

£7. a 56.0 

2.0 -4.2 

1.6 - 1 .6 

-I .0 -0 .2 
0.7 2.0 

-1.7 5 .a 

b.y»*i** 

5.0 7.4 

5 » vv 

4 . 5 • ‘ ^ ■ 

3 . 1 «• * *• 


48 H2. 2500 bKILL SCCRE IKPACI ON 

a/23 a/24 £/££ a/26 a/27 a/23 8/29 
53,3 51, 1 59,4 58.4 46,3 4C.2 48.5 

l.S 0.6 9. I 9.3 —1.5 -1.3 —1.2 


-0.3 2. 1 

- 0.1 1.1 
-1,6 -8.1 
-3.3 -4.0 


6.2 7.5 

4.2 7.0 

3.3 -3,7 

1 C . 0 3.4 


0.9 -0.2 
2.9 -C.3 
-2,9-1 7.2 
-2.6-14.5 


-1 . 1 
- 1.6 
-3. 1 
-S.l 


EURCP5 


8/30 3/2i 9/1 9/2 

51.5 44.9 46.2 50.7 

5 .4 -4 .4 -2.4 -2.5 

3.6 -2.3 -2-3 2i2 

1.4 -5.1 -5.2 -S.l 

-5.3-13 .3-10.2 -S,.Q 
-7.9-10.0 1.2 -7.7 


2. 6 *4»«: * 

3.6 -1.2 
— 3,5»».»» 

4 . I ^ « c * t 

3*0*^ • 

J • 8 • * ♦4** 


• 9 »v • 4 4*3***»4 —0*3 

-0.7 5.1 J.3<***» -2.9 -0.6 —3.8 — C. 9 —I.I 

— 2.6»*«** I •(! ************** 9 

— 0,U«**-»* 3.1»»»*» — 3.2»*»** — 4 ,2**4** 0.4 

— 5.a*«74«^ —4,2*- 

— 0 .6 < 


• »» *vEXPER IMENT ••♦*** ♦**«DIFF,Ff!aMl7336» ♦♦♦* 


AVE 

SD 

S£ 

AVE 

£0 

se 

£1 .08 

5.87 

1.57 

C.O 

0. C 

0.0 

5 C.29 

4.44 

1.19 

1.29 

4.77 

1.27 

5 0.09 

4.53 

1 .2 I 

1.49 

3.10 

0.83 

5 1 .34 

4. £8 

1 .30 

0.24 

3.81 

1. 02 

56.03 

3.35 

C.90 

-4.46 

6.39 

1.71 

53 .90 

4.20 

1.12 

-2.32 

6.71 

1.79 

5 1 .69 

5.99 

2.26 

-0, 13 

4.53 

1 . 71 

5 0.69' 

4. 05 

1 .1 8 

1.16 

3.65 

1.05 


7.33 

3.66 

C.22 

4.12 

2. 06 

50.83 

5- 07 

1 .92 

0.73 

3.71 

1.40 

51 .43 

7. 15 

3.20 

1.63 

4.13 

1. 35 

£4.85 

5. 11 

2.95 

1.98 

2.28 

1.32 
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Table 3 3b. ♦« Z500 P«s imppct on eopcpe 


EXP 8/20 

8/21 8/23 

8/23 8/24 

8/2S 8/26 

8/27 8/28 

8/29 8/30 8/31 9/1 

9/2 

• •*««EXPER1NENT ****** 

AVE SO SE 

****OIFP.PP0M«7336>**** 

AVE SO SE 

7336 «ls9 

84.6 53.8 

44.4 87.1 

04.5 73.7 

80.8 52.9 

83.6 77.9 59.7 55.2 

57.5 

61.97 

13.85 

3.65 

C.O 



78S« 6al 

9.S 4.1 

S.S ll.S 

18.6 11.9 

-4.1 4.* 

9.3 9.1 -3.1 -1.1 

2.9 

55.74 

10.85 

2.90 

8.23 

6.08 

1.62 

7970 3.3 

6.6 4.9 

1.0 14.9 

13.4 10.9 

1.3 8.1 

4.1 -1.5 -3.9 25.9 

7.9 

55.05 

14.42 

3.83 

8.92 

7.67 

2.05 

8036 2C.il 

41.S 8.1 


8.0 10.2 

2.4 S.l 

5.4 4.7 -7.5 -4.2 

1.2 

54.67 

17.65 

4.72 

7.30 

I1.84 

3.17 

8119 1.3 

5.9 0.1 

6.4 3.8 

4.9 -2.0 

2.8-10.0 


65.43 

17.4S 

5.04 

-2.90 

9.51 

2.75 

8130 -3.0 

16.4 -1 .8 

-0.4 8.3 

20.4 14.6 

5*1 -3*3 

-3.1-23.1 2.9 7.3 

9.4 

58.55 

14.80 

3.95 

3.42 

10.83 

2.09 


-0«8****4 


-1.8***** 

16.3***** 

14.4***** -5.7***** 

6.4 

58.13 

20.08 

7.59 

5.46 

8 .48 

3.21 

£645 1.4 

2.7 8.6 

12.6 9.7 

9.8 14.3 

19.4 2.5 

6.5 3.0 -2.4 -2.5 

14.1 

54.86 

14.14 

3.78 

7.11 

8.62 

1.77 


13.544*4* 




60.07 

21.01 

10.51 

6.00 

8.33 

4.16 

86624* 44* 

14.6***** 

6.1***** 



—7.5***** —8.5***** 

-3.0 

63.79 

20.39 

7.71 

-0.20 

8.92 

3.37 

86S244444 

8.3***4* 


7.7***** 


S,24«*4*-12.6*4*** 

15.2 

56.18 

10.35 

6.94 

7.40 

10.39 

3.93 



8.1***** 

20.1***** 



5.0 

56 .65 

12.52 

4.73 

8.91 

8.20 

3.10 
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Table 34 a 


HR. ZiCO SKILL SCCRS INPACT QN EUPCPL 


*<i**#HXPER IMENT ♦♦»•»** 1FF.FRDM{73363 


EXF 

G <r £ G 

37 Cl L/32 

6/23 a/2*t 

6/25 

fa/26 

a/77 a/28 

8/2.9 0/30 3/51 

9/1 9/2 

AVE 

SD 

SE 

AVE 

SD 

SE 

7J3S 

70.6 

72.4 66.6 

67.4 b7.e 

& 1 .5 

69.3 

57.7 51.3 

to. 9 56.4 50.1 

58.3 53.6 

62.49 

9.18 

2. 45 

C.O 

c.c 

0. 0 

7654 

4. J 

-0.4 -3.9 

4.5 1.6 

12.2 

1 .8 

-1.7 1 . S 

3. 9 -3.8 -7.1 

-0.9 -5.4 

o2.01 

6.56 

1.75 

C.4U 

4 .99 

1 . 33 

7970 

O.l 

• X> “* 2 . . 

4.0 2.C 

12.1 

7.5 

3.0 1.4 

5.4 -3.9 -7.2 

1^?, —1.9 

6 1 .20 

7.52 

2.0 1 

1.29 

5.02 

1.34 

6C36 

0.9 

-1 .5 0.1 

6-a 2.2 

6.B 

6.4 

2.5 1.8 

2.1 1 . 5 -a .5 

-2.9 -4.0 

61 .40 

7.55 

2.02 

1.09 

4.32 

1.16 

e 1 19 

2«a 

-1.0 7.4 

0.3 -6.9 

1 C-3 

-5.5 

-3.3 -e.7 

2.8-12.8-16.3 

-4.3 -8.0 

65.57 

5.40 

1.44 

-3. C9 

7.52 

2. 01 

e 130 

c ' 

w . C) 1 2 .6 

J . 0 - J . 0 

16.4 

6.5 

-7.4 -e.5 

4.3-16.3 -a .8 

l.i -7.0 

62.79 

5.51 

1.47 

-C. 30 

8.98 

2.40 

S6j7 # 

9 .54^4 


0 . 3« 

5.7 

— 0. 4 14 .O*^*^^* —0.4 

62.67 

9.59 

3.62 

C.76 

7.49 

2.83 

££<i5***** 

7.3 1 1 .3 

4.2 -U9 

C.3 

0.3 

0.3 *«• 

1.4 -6 .8 -9.8 

1.6 -3.2 

62 .24 

7.34 

2.12 

0.50 

5.83 

1.63 

c6Gl> 


/t • 4 4^ 4 # « 4^ 

— I.0viv4ti 

^ *iit* ¥■ 


66.10 

10. C9 

5.05 

3.69 

3.20 

1.60 

£60w 


9 . 2 4 « 4' « ^ 


4 • :4 « 4 V 4 « 

1 .9 •« « A* 

Q^y*¥¥¥if -a*7*4#** -i,o 

61 .93 

7.64 

2.89 

1.49 

5.54 

2. 09 


/ .^^t *** 

4 • « 

0.2‘ 


-2.54» ♦*♦ 


66.11 

e.93 

3.99 

1.95 

3.99 

1 • 70 

e'/cc,*^*** 

1 .3 

5. 

6.4> 

(: 4 ♦ # 44 




69.46 

6. ea 

3.97 

4.42 

2.59 

1.50 
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Table 34b. rz hr« zsoe rms impact o^ eupope 

•*«**EXPER1MENT ••«••• ••PPOtPP.PPONf 73361 •••• 



EXP 

7336 

6/20 

69.3 

6/£l 

76.4 

0/22 

60.9 

6/23 6/24 6/29 
80.0100.012S.4 

6/26 

93.3 

6/27 

61.1 

6/28 

73.1 

6/29 

62.6 

6/30 6/31 
84.2 60.6 

9/1 

62.6 

9/2 

S6.5 

AV6 

79.17 

SO 

18.26 

SE 

4.86 

AVE 

0.0 

SO 

0.0 

SE 

0.0 


7654 

14.0 

7.7 

-0.9 

10.7 

6. 7 

21.6 

0.3 

-0.9 

C.9 

12.2 

-7.1-16.4 

-6.3 

-4.3 

76.57 

14.22 

3.80 

2.60 

10.34 

2.76 


7970 

6.6 

0.4 

2.0 

8.2 

16.6 

24.4 

1 1 .8 

4.0 

1.4 

-C.l 

-9.5 -9.6 

31.1 

9.7 

72.36 

17.37 

4.64 

6.79 

1 1.62 

3.10 

LJ 

6036 

4S.9 

S2.7 

5.3 

9.6 

12.5 

13.7 

17.0 

5.5 

2.6 

6.3 

-0.9-12.4 

>6.2 

6.2 

67.69 

23.46 

6.27 

11.28 

16.03 

4.62 


I 


C1I9 ll.e S.l 10.6 17.2 7*« 22.2 -2.4 9.7 -C . I"- ie. 3 > 30 « l«4* •4*21 . 1 44«4* 62*04 19.93 9.79 (.36 16.47 4.79 

6130 S.4 22.3 4.0 6.4 16.6 36.4 24.3 1.1 6.S- 19.5>42 .6 *9.2 9.2 6.2 73.61 20.46 9.47 9.36 19.10 9.11 

66374*4** 10.244*4* 3.6***** 3.04**** 22.4*««**- 16. 1 *****-^36.0***** 3.0 62.12 24.72 9.34 >1.40 19.06 7.20 

6649 4.1 14.2 12.2 4.6 6.1 9.9 9.6 20.4 >3.1 >6.6>1 5.4- 17.0 -3.4 7.9 76.19 16.95 5.07 2.97 11.24 3.00 

6656***** 11.3***** 16.4***** 6.3***** 26.64* ••*•«***•**•**** ************ 75.09 26.90 14.29 19.70 6.14 4.07 

6662**««« 23.4***** >S.4l»**** 3.5***** 10 .9** ***-24.4*****- 16.0*****- 19.2 64.36 23.03 6.71 >3.67 17.62 6.66 

669?***** 16.4***** 4.5***** 6.3***** 1 0.9*****— 16.6****«-26. 2***4* 9.7 60.00 23.71 6.96 C.71 16.33 6.17 

6706***4* 12.2***** 17.1***** 24.6***** 27.9***** 1.2***«*>14.6***** 13.6 69.03 16.79 7.09 11.69 14.96 9.90 
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corresponding days. The first row contains actual skill score 
(or RMS) values for the NO SAT experiments 7336; the other rows 
contain the impacts determined by the differencing process 
described in Subsection 3. 3. 2.1. 


Considering the results for each experiment, we notice 
great variations in the daily values of skill scores for all 
quantities (for both p^ and (|) , over both verification regions, 
and at both verification times) ; typically negative as well as 
positive impacts occur, and they are of varying magnitude. These 
variations can be attributed to a number of factors, among which 
the quality of the satellite data during the 48h preceding the 
given day figures prominently , along with the synoptic situation at 
the initial forecast time itself. Other factors can be simply 
assumed to generate random differences in the impacts. 

A much more careful analysis than was possible up to the 
present would be needed to separate random influences on the im- 
pacts from those determined by the two factors we mentioned above. 
In the absence of such a separation, and in order to gain some 


overview of the experiments' impacts, we computed the results 
in the last six columns of the table. These computations were 
based on the assumption that all influences on the impacts, but 
that of the parameter varied from one experiment to the other 
(see Subsection 3.3. 1.2), were random. 


Let the entries in any of the Tables we discuss, 
the columns labelled 8/20 through 9/2, be denoted by x 


in any of 


. . , with 
13 


i 
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i the row number, M — 11, and j the column number, 

l£j£N, N = 14. Thus the actual skill scores for the NO SAT experi- 
ment are j » while the skill score impacts for all the 

other experiments are x.., l<i<M. 


The results in the three columns with the heading ''Experiment” 

represent an overview of skill scores themselves, i.e., of x . for the 

o:j 

first row, 1=0, and of yj=XQj+Xj^^, for the other rows, i?^0. The column 
headed "AVE" contains the averages x^= and 

^ ^ ^®spectively ; the column headed "SD" contains the standard 
d eviations 6. of x^ or y., defined by sj = ^ j =i (Vi j-y^) Vn, i?^0, and 
similarly for 6^. The column headed "SE" contains the so-called 

A 

Standard errors 6^ in estimating the means to x and y., i?«fO, re- 

A 

spectively; it is computed as 6^=6^//N. 


The results in the three columns headed "Diff. from (7336)" 

represent an overview of the impacts x^^, 0£i<M. The entries in 

the first row are therefore clearly zero. The column headed "AVE" 

contains x.=E^_ x../N, column "SD" contains a., a?=E^ (x..-x.)^/N 

and finally "SE" contains o ,=a . /y^. 

1 1 


We still see great differences between the results in the last 
three columns of Tables 27 through 34, from one Table to the other. 

A discussion very similar to the one concerning daily variations in 
results over the same area applies with respect to the variation in 
verification results over NA as compared to those over EU; the results 
of verification over these two regions can be considered as results 
of independent experiments in the case of 2-3 day forecasts. The 
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results for on the other hand should be rather closely correlated 
to those for (p, and so should the results for the same quantity at 
48h and at 72h. We are not prepared at the present to make the 
finer distinctions alluded to above in our analysis of ths experi” 
ments , and aim again for a "quick and dirty" overlook of all experi- 
mental results; a more rigorous analysis is in preparation. 

The final overlook of skill score results for our DST-5 
experiments is given in Tables 35 and 36. In Table 35, the results 
in column "AVE DIFF" of Tables 27a through 34a are simply repeated, 
but as percentages of the value of Xq in each Table, and with 
appropriate headings; let these entries be labelled x., , l<k<8. The 
last column of Table 35 then gives the "TOTAL" average Si impact of 

each experiment, x. = xf , x.,/8. 

1 k=l ik 


In Table 36 we have attempted to give a rough measure of the 
statistical significance of our experimental results. Such a 
measure has to be interpreted with caution, since the total number 
of forecasts for any given experiment is small, and some of the 
verified quantities for each forecast are not independent. 

k 

Without going into the details of statistical verification theory. 


and of hypothesis testing, we define our measure of statistical 
significance, or confidence in our results, in the following opera- 

/N 

tional way: in each one of Tables 27a through 34a, = x^/cr^, 

l<i<M, l£k_<8. These values are entered under appropriate headings, 

which identify k, in columns 2 through 9 of Table 36; the first 
column identifies i, or the experiments, as in the previous tables. 

The "TOTAL" measure of significance of any given experiment i is 
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£XP£« 
733 6 
7,e&« 
7570 
6036 

an 5 

6130 
c63 7« 

€c66* 

3662* 

B€9Z* 

6703* 


Table 35. 

Suimnary of 

NA 

percent impact in 

skill score. 

43 

SLP 

72 

Z500 
4 6 72 

SLP 

43 72 

ESt 

zsco 

48 72 

0.0 

0. 0 

O.C 0.0 

0.0 0.0 

O.Q 

0. 0 

2.45 

2.52 

0.42 -1.13 

2.32 3.61 

2.51 

0.77 

3.3 7 

4. 07 

1 . CO -0.71 

2.50 3.49 

2.89 

2. 06 

1.33 

3.46 

-0.27 0.16 

1.83 3.87 

0.47 

1.74 

-C.96 

-0.10 

C.67 0.24 

—3.44 —1.31 

—6.64 

-4.94 

1.35 

0.94 

0. 62 -1 .73 

—3.25 —1.44 

-4.50 

-0.48 

0.43 

1.90 

-2. Cl — 4.-tS 

— C.87 1.47 

-0.25 

1.22 

1.12 

3.06 

C.56 -C.S2 

—0.52 —0.33 

2.24 

0.60 

-7.95 

-2.56 

-4.42 -3.43 

—1.70 —0.95 

0.43 

5.90 

— 0.97 

1.45 

-1.77 -2.10 

-C.13 0.74 

1.42 

2.39 

2.34 

3. SC 

2.46 -2.22 

— C.20 -0.17 

3.16 

3. 12 

2#6S A.7C 
- INCCXJ^LETE 

3.67 2.03 

-5.46 -0.35 

3.84 

7. 07 




TCTAC 

0.0 
1.69 
2.40 
i.64 
-2.31 
-1.06 
-0.32 
0.76 
-1.89 
C.13 
1.50 
. 2.27 


ORIGINAL PAGE Ib 
-136 OF POOR QUALITY 



Table 

36. 

Averaae/standard 

error 

in skill 

score 

• 





NA 



ER 



TOTAL 


SLP 

zsoo 

56 P 

zsoo 


EXPLR 

48 

72 


4E 72 

48 

72 

48 

72 


73^t 

C.O 

0.0 


u.C 0.0 

C.C 

0 .0 

0.0 

0.0 

0.0 


I.8E 

1 .64 


C.22 — 0.54 

1.98 

2.21 

1.0 1 

0.36 

1. 1C 

7S7G 

2.5S 

2. J4 


t.48 -0.36 

2.32 

2.^3 

1.80 

0.96 

1.58 

ec36 

1.84 

2.83 


-C. 17 O.Q7 

1.53 

2.56 

0.24 

0. 94 

1.23 

£119 

- C. 52 

- 0. 05 


C.21 o.oa 

-1.80 

-0.45 

-2.61 -1.53 

-0.S3 

ai3c 

C.62 

C.40 


0.23 -0.57 

-1.14 

-0.49 

-1.29 -0. 13 

-C.29 

6£37# 

0.1 7 

0.56 


-C.54 -1 .54 

-C.46 

0.61 

-0.08 

0.27 

-0.13 


C . 6 5 

1.40 


C . 24 — 0 .38 

— C .43 

-0*24 

1.10 

0.30 

C.38 

CltZiO* 

-2.81 

- 1 . *5 


— l..:C — Q. 33 

— C.43 

-0.52 

0.1 1 

2.31 

-C.57 

££62* 

-U.36 

O.SI 


— C.52 —1.13 

-C.IO 

0.29 

C.52 

0.71 

-C.Ol 

6c92^ 

c.ao 

1.27 


C.84 -0.85 

-C.15 

— 0.08 

0.88 

1 . 10 

C.46 

fl7oa* 

1.2 ! 

2.25 


C.77 1.3S 

-2.26 

-0.14 

1.50 

2.95 

C.95 


• - incomplete 


then given in the last column of the Table by simple averaging, as 
for Table 35 , values are related 

to a standardized score, or z score, for the mean of the impacts, 
terms of a probability distribution with zero mean and unit 
standard deviation. In this treatment we have neglected 
the uncertainty in estimating the standard deviation of the mean 
impact; this uncertainty would be taken into account in the care- 
ful application of a Student's t-test to the confidence limits of 
the mean. We hope to give a more detailed statistical analysis of 
our results in a future publication. At this point we would only 
like to remark that for a number of degrees of freedom v, or sample 
size N, V = N-1 = 13, the t-distribution is practically undistinguish- 
able from a standardized normal distribution; the remark is valid 
a fortiori if we are willing to grant that verification results over 
Europe are independent of those over North America, and hence 
V = N-1 ••= 23. 

After these remarks we shall limit ourselves to saying that we 
have very little confidence in the results of a given experiment i 
if lc.i<0.5, reasonable confidence if 0.5<1?^1<^2, and very high con- 
fidence if 2<|Cj_|- It might be worthwhile to remember that the values 
0.5, 1, 2orz=5^ correspond to th6 following well known values of the 
cumulative distribution function F(z) of a normal distribution 
with zero mean and with standard deviation unity: 

F{0.5) = 0.69, F(l) = 0.84, F(2) = 0.98 . 

Having described the presentation of our results in the Tables, 
we proceed to their preliminary assessment. As indicated already 
in Subsection 3. 3. 1.1, some DST-5 e.xperiments are still in progress; 
they use modifications of SAM which were based on intervening 
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experience with DST-6 experiments. We shall discuss only experiments 
7854 through 8130, which have been completed. 

A look at the last column of Table 36 indicates that the re- 
suits ot the two SAM experiments, 8119 and 8130, completed for the 
summer DST period, have at most marginal statistical significance. 
The bias removal described in Subsection 3. 3. 1.2 tor 8119 did not 
seem to help. Columns 2 through 3 of Table 35 seem to give some- 
what better skill score impacts over North America for 8130, but 
the results over Europe (columns 6 through 9) are negative for 8130 

as well as 8119. 


The statistical significance ot the results for the two 
dim experiments, 7854 and 7970, and of the SCM experiment 8036, 
seems reasonable good (siH.D- The best total skill score impact 
obtains, surprisingly enough, for DIM experiment 7970, which util- 
ised only data from one satellite, NIMBUS-6, processed by NESS. 

Neither the use of data from two satellites (7854) , nor the use of 
SCM, a somewhat more sophisticated assimilation method (8036) , yielded 

an improvement . 

The interpretation of satellite-data impacts for the DST-5 
period is made rather difficult, however, by the fact that, during 
that period, the synoptic situation was particularly sluggish (see, 
for instance. Subsection 3. 2. 6.2, 4). This means that useful in- 
formation from satellite data over the ocean basin upwind from a 
verification area does not reach that area in useful time, i.e., not be- 
fore the information is completely distorted by the model's insufficient 
predictive capabilities during the assimilation process. It is there- 
fore somewhat surprising that a positive impact, with moderate 
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Table 37. Summary of percent impact in rms errors. 


NCRTH AMERICA 
SUP Z500 


EXFER 

43 

72 

48 

72 

7236 

Q. C 

0.0 

0 .0 

0.0 

7654 

6. 12 

7.00 

4.86 

6.52 

7S70 

3* £7 

5.29 

-C.CS 

0.53 

6G36 

1.33 

3.20 

-2 . 17 

-1.28 

61194 

3.21 

2.98 

4.31 

4.66 

8 130 

4.66 

4.48 

2.61 

-5.08 

6637* 

-0. 48 

6.66 

0.04 

-5. 59 

8645 

0. 12 

2.26 

1.62 

-2. 80 

86564 

-10.76 

1 .79 

-23.57-lC.76 

86624 

- 12. 71 

2.53 

-5.29 

-6.16 

86924 

4.33 

4.32 

6.58 

-2.38 

87084 

0.63 

7.46 

-1.66 

-0.02 


* INCOPPUETE 


EUROPE 

SUP 

48 72 

Z500 

48 72 

TOTAL 

0. 0 

C.O 

0.0 

0.0 

0.0 

14.14 

9.08 

10.06 

3.28 

7.63 

11.22 

9.18 

11.17 

8.58 

6.19 

10.32 

9.79 

11.78 

14.24 

5.90 

6.23 

14.17 

-4.68 

0.48 

3.92 

12.52 

12.17 

5.52 

6.77 

5.46 

-2.36 

-7.57 

8.81 

-1.77 

-0.26 

4 

CM 

• 

If) 

3.18 

11.48 

3.76 

3.11 

-4.65- 

14.31 

9.68 

19.82 

-4.10 

1.93 

3.01 

-0.32 

-4.63 

-2.71 

-1.98 

-5.75 

11.95 

0.90 

2.24 

4.52444444 

11.15 

14.77 

-23.31 
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significance in rms error. 
eurfdPE 

SLP 7f(flo 


48 72 

zsoo 

48 72 

rOTAC 

c*o 

0»0 

0.0 

0.0 

0.0 

7«44 

4.03 

3.84 

0*94 

2«98 

6.68 

3«27 

3.38 

2.19 

2«38 

2*S9 

3«7C 

2.31 

2.34 

1*50 

1*27 

2.S4 

-1.C6 

0.08 

0.99 

2*03 

1.86 

1.18 

t.os 

1.07 

'“0.31 

-1»80 

1.70 

-0*19 

0.07 

1*58 

U3S 

4.02 

0.99 

1*05 

• 

-1*23 

1.44 

3.86 

-0.26 

0*33 

1«40 

-0. C6 

-0.55 

-0.23 

-€•38 

-1.67 

1.88 

0.12 

0.38 

C.62 

-C.97 

2.23 

2.13 

0.73 


statistical significance, was obtained at all in the summer experi- 
ments . 

The summary of rms results for DST-5 experiments is given in 
Tables 37 and 38; Table 37 contains average impacts. Table 38 dis- 
plays their statistical significance. We notice immediately that 
both the impact itself and the confidence we can have in it are 
much better for the rms results than for the analogous results; 
the reason for this is not clear. These rms results, are somewhat 
encouraging, but they cannot by themselves change our conclusions with 
respect to the summer experiments: we still have to regard them as 
inconclusive . 

With this comment we turn to the presentation and discussion 
of results for the winter experiments. 

3. 3, 2, 3 DST-6 Results 

Results have been obtained, as of the time of this writing, for 
part of the DST-6 period, namely for January 30 through February 21. 

Since this period is somewhat longer than the DST-5 period, it was 
only feasible computationally to perform forecasts for every second day, 
starting with February 1, February 3, and so on, till February 21. Thus, 
eleven forecasts have been performed for each complete experiment. 

The same quantities have been computed for «?ach forecast as 
described in the Introduction (Subsection 3. 3. 2.1), and discussed 
in further detail in the previous Subsection (3. 3. 2. 2). We present 
in Tables 39a-39h the Sj_skill score results for p_ (SLP) and 
(Z500) at 48h and 72h, over North America (NA) and over Europe (EU) ; 
this corresponds to Tables 27a, 28a, 29a, 30a, 31a, 32a, 33a, 34a 

of Subsection 3. 3. 2. 2. The corresponding RMS results are given ii} 

« 
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T^ble 39a. 4d HA. iLt> SKILL SCCRE I LRACI CN NCRTH A»iEM1CA 


tXPERIMENT***** ••••*«0IEF.FRaM(7S7S>****** PRCNT. 


EXP 

2/ 1 

2/3 

2/5 2/7 

2/9 2/11 2/13 

2/15 2/17 2/19 

2/21 


SO 

S8 

AVE 

SC 

£E 

A V/SE 

IMPACT 

757d 

78.8 

S3. A 

72.1 88.2 

81.0 84.2 74.0 

7C.0 59.8 73.6 

64.9 

72.73 

10.43 

3.15 

0.0 

c.c 

0.0 

O.C 

0.0 

82 AO 

-e.l 

2.2 

-0 .6 3.3 

-C.2 2.2 7.2 

— 4«2 C«6 — J* 4 

-0.3 

7 2«ub 

1 1.01 

3.32 

0.06 

3.72 

1.12 

0.C6 

0. 09 

8A97 

*0.8 

6.5 




7 1.33 

:6.9& 

6.46 

1.79 

3.69 

1 .64 

0.97 

2.46 

dJio 


7.0 

-A.O 10.6 

8.2 7.8 5.9 

0.7 -3.3 -8.8 

0.3 

7C.97 

10.60 

3. 19 

1 .75 

6.51 

1.96 

0.89 

2.41 

83;,: 

-A. 3 

6.7 

0.8 10. A 

4*3 6*6 

0.3 4.6 -8.6 

1.2 

70 .48 

1 1 .64 

3.51 

2.25 

S.31 

1.60 

I .40 

3.09 

dAOb 

-3.7 

3.3 

-2.6 5.1 

1.3 I .4 3.6 

-1 .9 -2.2 -2.3 

1 .8 

72.37 

1 O.AS 

3. 15 

0.35 

2.98 

C.90 

0.39 

0.49 

EAA7 

-2.8 

6.6 

0.6 10.2 

3.9 -l.A 7.0 

-2.6 2.5 -9.4 

-6.4 

7 1.95 

1 1 .55 

3.48 

0.77 

5.95 

1.79 

0.43 

1.07 

EA72 

-3.7 

S.l 

-l.A 10.0 

6.3 0.5 9.1 

-2.1 3.1-IJ.O 

1.2 

7 1.35 

11.91 

3.59 

1.36 

6.53 

1.97 

0.70 

1.90 

ed«s 

-2*9 

6.7 

-5.9 11.2 

6.9 5.9 11.6 

3*7 2*4 — 

1.2 

69.64 

11.21 

3.38 

3.09 

6. 26 

1 .89 

1.64 

4.25 

606o 

-5.6 

8. A 

-A. 7 8.3 

4.2 9.2 11. 8 

6.9 -C.l -3.8 

1 .6 

69.45 

11.64 

3.51 

3.28 

6. 17 

1 .86 

1 .76 

4.51 

857a 

-3.5 

S.l 

1.7 1*1 

1.6 3.5 7.9 

11.4 3.1 -3.5 

-0.9 

70.50 

12.57 

3.79 

2.23 

A. 55 

1.37 

1 .62 

3.06 

e&ei 

-2.0 

3.5 




0000 

69.28 

16.91 

9.76 

-1.18 

4.39 

2.83 

-C.A7 

-1.62 

8a^J 

-2.1 

6.7 

-5.2 9.1 

7.1 7.2 11.7 

5«4 4.S -6«9 

0 .3 

6 9.30 

1 1 .42 

3.44 

3.43 

6.05 

1 .83 

1.88 

4. 72 

tL<,'3 

-1.2 -1.3 

-1.7 3.54 



0000 

7 3.29 

13.19 

6.59 

-0.17 

2.46 

1.23 

-0.14 

-0.23 

CAVE 

-3. A 

5. 1 

-2.3 7.1 

A. 2 3.8 8.2 

1.6 1.5 -6.6 

0.0 









C&CMA 

1 .6 

2.t 

2. A 3.S 

2.7 3.5 2.6 

4.7 2.6 3.2 

2.3 









CSc 

C.A 

0. 7 

0.7 l.C 

C.9 1.1 c.a 

1.3 0.8 1.0 

0.7 









CAVSE 

-7.6 

7.4 

-2. A 7.1 

A. 9 3. A 9.9 

1.2 1.9 -6.6 

C.O 









CAVNS 

-A. 3 

9.6 

-3.2 8.1 

5.2 4.5 11.1 

2.5 2.5 -9.0 

0.0 
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•«*«*«EXPEBIMENr«A*«* •««***OIPP.FBOM( Tsrsi****** PRCNT. 

EXP a/I 2/3 2/s 2// 2/B 2/11 2/13 2/15 2/lT 2/l« 2/21 


EA97 >1.2 1.0 S.O-IO. 


8310 -7.1 

9.4 

2.6 

9.3 

17.8 

14.9 

4.7 -4.1-14.7 -7.9 

-7.6 

83S2-IA.A 

3.7 

5.6 

7.5 

3.5 

IS.I 

5.0 0.1 -9.7 -1.6 

-4.8 

BAOS-12.0 

4.7 

-2.8 

0.3 

1.4 

-1.2 

5.2 -3.7 -4.5 5.8 

-4.3 

8447 -7.9 

2.8 

6.0 

8.4 

5.6 

8.0 

8.1 -6.7 -7.8 -1.1-12.7 

8472 -8.2 

1.9 

6.3 

10.3 

IS. C 

5.5 

9.5 -0.1 -8.1-15.6 

-2.E 

■545 -3.7 

8.1 

3.9 

12.7 

1C. 9 

7.2 

11.8 -0.6 -5.7 —2.6 

3.0 

856b -4.9 

8.4 

-0.3 

10.2 

13.5 

16.4 

10.5 1.5 -5.7 -2.8 

5.2 

ES74 -e.o 

-3.0 

4.6 

5.7 

10.9 

0.2 

7.3 -1.0 4.8 -0.6 

1 .9 

8581 -1.3 
8593 -2.8 

4«2 

6.7 

• & «ft ^ 
3.9 

12«t 

12.6 

10.0 

12.5 1.5 -4.2 -3.6 

1.4 

(695 1 .9 

■•ft • 2 

1 0 «ft 

— 1*9‘ 






7VE 

SO 

SE 

AVE 

SO 

SE 

AV/SE 

IMPACT 

80.74 

12.14 

3.E6 

0.0 

0.0 

0.0 

O.C 

0.0 

79.97 

10.67 

3.22 

0.76 

6.31 

1.90 

0.40 

0.94 

86.48 

15.20 

7. CO 

-1 .25 

7.07 

3.54 

-0.35 

-1 .55 

79.16 

7 .59 

2.29 

1.17 

10.57 

3.19 

0.49 

1 .95 

79.82 

9.72 

2.C3 

0.91 

C.29 

2. sc 

0.37 

1.13 

8 1.75 

12.24 

3.69 

-1 .01 

5.29 

1.59 

-0.64 

-1.26 

80.12 

7.97 

2.40 

0.61 

8. 13 

2.45 

0.25 

0. 76 

79.49 

7.61 

2.29 

1 .25 

9.28 

2.8C 

0.45 

1.54 

76.65 

8.36 

2.52 

4.09 

e.s/ 

1.98 

2.06 

5.06 

c 

• 

o 

o 

9.40 

2.83 

4.73 

7.64 

2.30 

2.06 

5.86 

78.65 

10.24 

3.C9 

2.08 

5.26 

1.59 

1.31 

2.58 

8 1.02 

12.54 

7.24 

0.35 

3.37 

1.95 

0.18 

0.43 

75.99 

8.60 

2.59 

4.74 

6.68 

2.01 

2.35 

5.88 

8 4.63 

10.61 

5. 30 

0.59 

7.83 

3.92 

O.IS 

0.73 


CSE 


6.0 

2.9 

3.9 

5.7 

9.4 

8.8 

8.2 -1.9 

-5.8 -2.6 

-2.5 

4.4 

5. 1 

3.5 

6.6 

5.8 

5.8 

2.7 2.9 

4.8 5.7 

5.2 

1.2 

1.4 

1.0 

1.9 

1.8 

1.8 

C.8 0.9 

I.S 1.8 

1.6 

4.9 

2. 1 

3.9 

3.0 

5. 1 

4.8 

9.7 -2.1 

-3.8 -1.4 

-1.5 

8.0 

3.9 

4. 1 

s.« 

9«4 

IC.I 

IC.2 -3.C 

-9.0 -3.6 

-3.2 
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44 4 44 4 EXPERIMENT 44 444 

44 44440 IFF .8 ROM! 7S7SI444444 


EXP 

2/1 

2/3 

.2/5 

2/7 

2/9 2/11 

2/13 

2/15 2/17 2/19 2/21 

4VE 

SO 

SE 

AVE 

SO 

SE 

AV/SE 

IMPACT 

>5 78 

38.9 

36.8 

41.1 

47.2 

41.4 31.4 

40.5 

40.1 32.7 42.7 42.6 

39.58 

4.54 

1.37 

0.0 

0.0 

0.0 

0.0 

0.0 

82«U 

-2.3 

1.2 

3.1 

2.7 - 1.8 0.1 

5.0 

0.6 -2.5 -3.2 -0.3 

39.33 

4*64 

1.40 

0.25 

2.61 

0.79 

0.32 

0.63 

e««7 

-1.9 

3.8 

-3.6 


4 3.53 

9.43 

4.72 

-2.53 

5. 06 

2.53 

-l.CO 

-6.39 

E3I0 

3.9 

4.4 

-0 .4 

4.1 

5.6 1.1 

3.4 

3.9 -4.3 -6.9 2.0 

38.05 

5.38 

1 .62 

1.53 

3.95 

1.19 

1 .29 

3.87 

ejs< 

1 .3 

2.6 

1 .1 

4 .4 

3.7 1.3 

4.7 

1.6 -1.4 -2.8 0.9 

38.00 

4.4 1 

1.33 

1.58 

2.29 

0.69 

2.30 

4.00 

0405 

-1*4 -0.6 

1 .7 

0.9 

€•1 0«1 

1 .7 

-2.2 C.9 -1.4 -1.3 

39.7 1 

4.79 

1 *44 

-0. 1 3 

1.35 

0.41 

-0.31 

-0.32 

a««7 

c.s 

2.6 

-0.9 

4.5 

3.4 -0.1 

6.1 

3.2 1.1 -4.3 -0.9 

38.20 

5.11 

1.54 

1.38 

2«94 

C.89 

1 .55 

3.48 

84 72 

1.2 

t .6 

0.1 

4.0 

5.2 -0.6 

6.5 

1.7 -2.6 -6.5 2.1 

38.44 

4.85 

1.46 

1.14 

3.61 

1.09 

1.05 

2.88 

8545 

1 .5 

3.1 

-1.9 

3.3 

5.2 1.9 

7.5 

3.8 -2.4 -3.3 2.3 

37.66 

5.09 

1.54 

1 .92 

3.32 

1.00 

1 .92 

4*86 

CS66 

0.6 

3.7 

-2.0 

1 .3 

5.1 3.9 

7.3 

5.9 -2.6 -3. 7 1 .5 

37.67 

5.90 

1. 78 

1.91 

3.63 

1.09 

1.74 

4.82 

ES74 

0.7 -0.5 

0 .2 -0.1 

2.6 - 1 .6 

5.3 

1.6 -2.344444 0.8 

38.60 

4.07 

1.29 

0.67 

2.18 

0.69 

0.97 

1 .69 

8sei 

1.7 

1.2 

-2.24 





38.7 1 

4.06 

2.34 

0.22 

2.12 

1 .22 

0.18 

0.56 

8593 

1 .9 

3.1 

-3.3 

2.9 

5.0 1.6 

7.5 

3.7 -1.6 -3.7 2.4 

37.81 

5.35 

1.61 

1 .77 

3.41 

1 .03 

1.72 

4.47 

8695 

-4.3 -O.I -2.4 

-1.24 




4 3.00 

4.73 

2. 37 

-2.00 

1. 79 

0.90 

-2.23 

-5.05 

CAVE 

0.3 

2.0 

-C.S 

I.S 

3.4 c.e 

5.5 

2.4 -I.B -4.0 0.9 









OSCMA 

£ • 1 

1.6 

1.9 

3.5 

2.4 I.S 

1.8 

£•1 t«6 1*6 1*3 









CSE 

0.6 

0. 4 

C.S 

1.0 

0.7 c.s 

0.6 

0.7 C.S 0.5 0.4 









CAVSE 

C.5 

4.5 

- 1.5 

1.5 

4«e 1.7 

S.6 

3.4 -3.5 -7.4 2.3 









CAVN5 

0.7 

S.S 

- 1.9 

J.3 

8.2 !.S 

13.5 

S.f -5.4 -9.4 2.2 
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ERR 

2/1 

2/3 

2/5 2/7 

2/9 2/11 2/13 2/15 

2/17 2/19 2/21 AVE SO SC 

•*444401EF .FROM! 75781444444 

AVE SO SE AV/SE 

RRCNT. 

IMPACT 

7S7B 47.7 46*6 49.3 S2.8 83.5 37.4 44.2 44.3 

38.4 51.7 47.4 

46.66 

5.33 

1.61 

0.0 

0.0 

0.0 

0.0 

0.0 

8240 - 

3.8 -1.6 

• 

1 

0 

• 

1 

1.9 - 

2.3 

4.3 -3.4 

-C.t 4.1 - 

2.9 

47.18 

5.67 

1. 71 

-0.52 

2.94 

0.89 

-0.59 

-1.11 










50.00 

8.54 

4.27 

-0.90 

6.22 

3.1 1 

-0.29 

-1.93 

8497 - 

3.3 

5*7 









8JI0 

4.5 1 

11.0 

1.2 -0.2 

C.9 

1 .1 

1.6 -1.9 

-3.2 -0.9 

4.5 

44.25 

5.62 

1.69 

2.4 1 

4.43 

1.34 

1 .81 

5.17 

8352 - 

1.2 

6.9 

1 .3 -2.8 

5. 1 

C.9 

2.5 -0.3 

-2.9 2.4 - 

0.9 

45.68 

5.44 

1.84 

0.98 

3.10 

0.93 1.05 

2.11 

84C5 - 

3.5 

3.4 

0 .8 -1.1 

1.2 - 

2.1 

1.1 -3.3 

-1.8 3.9 - 

0.9 

46.87 

4.77 

1.44 

-0.20 

2.50 

0.75 -0.27 

-0.43 

E447 

0.7 

7.5 

0.5 -0.3 

8.3 

1.4 

4.9 2.2 

-1.6 4.5 

0 .8 

44.22 

5.21 

1.57 

2.44 

2.92 

0.88 2.77 

5.23 

84 72 

0.1 

4*6 

2.1 2.5 

9.6 

0.8 

4.9 1.6 

-2.4 -3.8 

3.9 

44«4tf 

5.36 

1.82 

2.19 

3.69 

l.l 1 

1 .96 

• 

4f69 

E84S 

3.0 

9.7 -0.5 2.8 

7.2 

0.1 

8.1 -0.4 

-4.7 2.1 

4.6 

43.75 

5.16 

1.55 

2.92 

4.28 

1.29 2.26 

6.25 

8546 

1.8 

9.4 -2.2 0.7 

7.8 

5.9 

6.8 1.9 

-4.5 4.7 

5.4 

43.24 

6.19 

1.87 

3.43 

4.28 

1.29 2.65 

7.34 

85 74 

1.1 

0.8 -0.2 -1.7 

- 

'2.8 

4.9 —0.6 


2.1 

45.47 

4.78 

1.51 

0.69 

2.62 

0.83 0.83 

1.47 

8581 

2.5 


i 




1444 

4 7.23 

4.89 

2.82 

0.63 

3.59 

2.08 0.31 

1.36 

8593 

3.1 

9.3 -0.4 3.2 

7.7 

1 .9 

7.8 0.1 

-3.6 0.9 

5.9 

43.40 

5.44 

1.84 

J.26 

4.04 

1.22 2.68 

6.98 

8695 -3.7 -3.9 

1 .4 -2.741 





1444 

5 1.34 

3.17 

1 .58 

-2.24 

2.46 

1.23 -1.82 

-4. 79 

CAVE 

0.1 

5. 1 

0.4 -0.7 

5.7 

C.5 

4.7 -0. 

4 -2.6 2.0 

2.2 






C 9 


OSCMA 

2.8 

4.4 

1.7 3.0 

3.4 

2 *4 

2.3 1. 

9 1.4 2.7 

2.9 







cse 

0.8 

1.2 

0.5 C.9 

1.1 

0«8 

0. 7 0. 

6 0.4 b.9 

0.9 






n? o 


CAVSE 

0.1 

4.2 

C.9 -0.8 

5.3 

0.6 

6.4 -0. 

7 -6.2 2.2 

2.4 






V 

< 

o — 
u eg 


CAVNS 

0.2 

to. 9 

C.9 -1.4 

10.8 

1.3 

10.6 -C. 

m 

• 

• 

1 

4.7 






> 

1 





l^tble 39e. **■*’ skill scene me act om euncpe 


2/1 

2/3 

2/5 

>A.7 

7A .A 

55.7 

1.3 

-0.5 

2.6 

6.7 

-A .6 

13.1 

5.7 

1 1 .A 

0.1 

•1.7 

0.9 

A .A 

0.7 

3.5 

5.7 

o 

• 

0 

1 

-1.6 

8.2 

A.A 

1 .9 

10.1 

0.7 

0.7 

5.5 

•2.2 

1.1 

7.1 

•3.5 

-2. A 

-5.A 

A. 7 

3.5 

2.7< 

1.7 

1 .3 

6.9 

3.9 

-2.3 

3. A 


••* •••expert I MLNT** ••• 

Ave so se 


••••••Ol FF .FROM! 7578I****** 

Ave so se Av/se 


PRCNT. 

impact 


e^AO -1.3 -O.s 2.6 2.6 -1.2 -1.4 -2.2 >.3 C.6 l.I 1.9 61.68 

8*9/ 6.7 -A.6 13.1 0.9A********************************** S9.1I 

8310 S.7 II. A 0.1 2.8 0.2 -5.9 I .A O.A 9.2 l.A 0.6 59.A7 

8352 -1.7 0.9 A.A 2.1 0.2 -5.1 1.7 2.7 2.2 2.9 1.1 60.91 

8A05 0.7 3.5 5.7 2 . 6 - 0. 6 - 1 . 5 -0 .2 1.9 C.9 2.1 0.9 60.50 

8AA7 -0.0 -1.6 8.2 3.2 -2. A -5.1 l.A A. 7 2.7 2.0 A . 1 60.38 

8A72 A.A 1.9 10.1 A. 3 -C.9 -A.O -0.5 O.l 9.2 1.8 A.A 59.15 

85A5 0.7 0.7 5.5 5.5 -2.3 -A.A 1.6 -O.A 13.3 5.3 A. 9 59.21 

8566-2.2 1.1 7.1 A.3-2.5-A.1 1.6 0.313.6 0.7 1.7 60.00 

857A -3.5 -2.A -5.A -1.5 -1.1 0.3 1.8 2.1 A.6-0.9 1.7 62.35 


8593 1.7 1.3 6.9 A.O -2. A -A.A 1.8 0.6 12.1 3.8 3.9 59.21 


CAve 1.5 1.0 e.o 2.9 — 1.3 - 3.6 c.8 i.a 6.9 2.0 2.5 

OSCMA 3.2 3.8 A.A 1.8 1.0 1.8 1.3 l.S A. 9 1.6 1.5 

cse 0.9 1.0 1.2 0.5 0.3 C.6 O.A O.S 1.6 0.5 0.5 

CAVSC 1.7 0.9 A.O 5.6 -A. 1 -C.2 2.1 3. C A.A 3.9 5.2 

CAVNS 2. A 1.3 8.9 5.1 -2.2 -t. 7 1.7 2.1 11.2 3.3 3.6 


6.73 

2.03 

0.0 

o 

• 

o 

0.0 

0.0 

0.0 

6.83 

2.06 

0.28 

1.77 

0.53 

0.52 

O.A5 

1 A.99 

7. A9 

A. 06 

7.61 

3.81 

1.07 

6.55 

6.7A 

2.C3 

2. A8 

A. 77 

1 .AA 

1.12 

A. 00 

7.82 

2.36 

1.0a 

2.57 

0.78 

1.35 

1 .69 

6.8A 

2.06 

1 .A6 

2.02 

0.61 

2. AO 

2.35 

8.37 

2.53 

1.57 

3. 71 

1.12 

l.AO 

2.5A 

8.23 

2. A8 

2.6 1 

A. 26 

1.28 

2.19 

A. S3 

8.8A 

2.67 

2.7A 

A.8A 

I.A6 

1.88 

A. A3 

9.16 

2. 76 

1.95 

A. 96 

1 .A9 

1.31 

3.15 

7.29 

2.20 

-0. AO 

2.87 

0.86 

-0.A6 

-0.6A 

9.01 

5.20 

3.62 

0.98 

0.57 

6.A1 

5. as 

8.63 

2.60 

2. 7A 

A.A6 

I.3A 

2.CA 

A. A3 

11.05 

5.53 

2.16 

2.96 

1 .A8 

1.A6 

3.A9 


•feble 39f 


72 MR. SLR smut SCO« IMPACT OM euPCPE 


EXP 

2/1 

2/3 

2/5 

2/7 2/9 2/11 

2/13 

2/15 

2/17 

2/19 

2/21 

7578 

74.6 

73.7 

65.5 

75.6 59.9 61.8 

66.4 

75.7 

53.1 

88. 1 

75.1 

8240 


-3.8 

4.» 

4.0 -2.7 0.6 

-4.7 

4.2 

-3.1 

3.3 

8 • 6 

»4444 

849/ 

5.1 

-8.7 

8.4 







8310 

8.1 

20.2 

-3.4 

6.4 C. 6-12. 7 

-0.9 

8.4 

1.5 

4.6 

1.3 

8352 

2 • ct 

-1.2 

4 • 8 

7.0 1.6 -4 .6 

-1.9 

5.5 

-2.5 

3.4 

5.4 

84 06 

-0.7 

2.7 

5.7 

3.8 -1.1 C.4 

-0.7 

1.6 

2.3 

5.9 

1 .6 

8447 

8.4 

1.1 

1 1 .8 

9.1 1.8 -5.7 

-4.8 

10. 1 

-1.2 

0.5 

7.1 

8472 

10.5 

5.8 

3.4 

8*8 l»3 

-0.4 

1.9 

7.4 

0.4 

3.0 

8545 

2.6 

5.9 

4.5 

8.6 -5.7 -4.7 

3.5 

-1.7 

7.8 

13.8 

2.9 

856u 

1.9 

6.7 

6.3 

8.3 -3. 7 -6. 1 

4.5 

2.4 

5.8 

0.3 

-0.2 

8574 

-0.3 

-2.4 

2.8 

-1 .7 -2.9 -3.7 

0.8 

7.7 

-C.2 

5.9 

3.0 

8581 

3.2 

4.8 

0.4< 


• 444« 





8593 

5.0 

6.7 

3.0 

8.2 -2.4 -5.1 

4.2 

-0.9 

7.5 

1.2 

1.2 

8695 

5.1 

-2.9 

1.5 








«VE so 

69.97 9.71 

69.31 8.51 

68.48 10.58 

66.87 9.28 

68.14 8.08 

68.01 8.97 

66.77 9.49 

66.68 10.30 

66.56 8.59 

6 7.59 10.29 

69.15 8.32 

68.47 3.18 


•••••401 FP .FROM! 7S78>4*4«** PRCN7. 


69.39 5.29 


CAVE 3.6 2.7 A. 1 6.6 -1.3 -4.5 -0.0 3.9 2.5 3.9 3.2 

CSCMA 3.3 6.8 3.6 3.2 2.4 3.5 3.2 3.E 4.1 3.9 2.3 

CSE 6.9 1.9 1.0 0.9 0.8 1.1 1.0 1.2 1.3 1.2 C.7 

CAVSE 3.9 1.4 4.2 7 . 3 - 1 . » - 4 . 1 - 0. 0 3.3 2.0 3.2 4.4 

CAVNS 4.8 3.t t.3 6.7 -2.2 -7.3 -C.1 5.2 4.8 4.5 4.3 


SE 

AVE 

SO 

SE 

AV/5E 

IMPACT 

2.93 

O.C 

c.o 

0.0 

O.C 

0.0 

2.57 

0.66 

4.01 

1.21 

0.54 

0.94 

5.29 

3.92 

8. 70 

4.35 

0.90 

5.60 

2.80 

3.11 

8.24 

2.49 

1.25 

4.4» 

2.44 

1 .84 

3.86 

1.16 

1 .58 

2.62 

2.71 

1.96 

2.45 

0.74 

2.66 

2.81 

2.66 

3.20 

5.94 

1.79 

1.79 

4.57 

3.11 

3.29 

4.02 

1.21 

2.72 

4.71 

2.59 

3.41 

5.80 

1.75 

1.95 

4.88 

3. 10 

2.38 

4.54 

1.37 

1.74 

3.40 

2.51 

0.82 

3.68 

1.11 

0.74 

1.18 

1.84 

2.80 

2.24 

1.29 

2.17 

4.00 

3.11 

2.60 

4.27 

1.29 

2.02 

3.72 

2.64 

3.01 

4.81 

2.41 

1.25 

4.30 


> > 
^ o 


Table 39g. hr. zsoo skill score ikpaci on eurcpe 


EXP 

2/1 2/3 

2/3 

2/7 

2/9 2/11 

2/13 2/13 

2/17 

2/19 

2/21 

1378 

SO.t 47.2 

30 .3 

61.8 

43.2 44.3 

30.2 68.4 

56.3 

S3. 1 

67.2 

• 2«0 

-2.4 -0.2 

1 .1 

1 .2 

-0.3 -2.0 

-4.9 0.3 

-0.0 

1.0 

8.3 

• 4R/ 

2.8 -0.9 

4.2 

3 .34 




'••••< 


8310 

6.1 3.8 

-0.6 

3.8 

3.9-12.1 

0.2 -9.3 

-0.6 

3.4 

7.8 

8332 

-1.3 0.9 

2.6 

1 .8 

-l.I -7.9 

1.4 2.2 

-1.4 

2.6 

6.7 


1.4 3.0 

I .1 

3.0 

-0.6 0.3 

-0.8 1.8 

-0.6 

2.0 

4.0 

0447 

C.l 0.4 

4.3 

4.6 

-1.3 -6.9 

2.2 3.4 

0.7 

2.3 

7.8 

<4 72 

6.0 -1.9 

3.4 

6.7 

2.6 -3.4 

1.4 -3.7 

1.9 

1.6 

3.7 

(34b 

4.0 0.4 

3.8 

6.3 

2.2 -3.4 

4.2 -3.8 

3.1 

4.7 

6.9 

ab()«> 

4.4 0.6 

4.2 

4.9 

2. 1 -3.1 

2.8 -3.6 

4.2 

2.8 

4*6 

0574 

8501 

1«0 0«4 ~3«6 ~0«4 

2.6 -1.3 

1.3 -1.1 

0.4 

1.1 -0.4 

8393 

3.3 1.3 

3.3 

6.0 

1.6 -3.8 

3.4 -5.6 

2.4 

4.3 

6.2 

0695 

0*1 *’J«6 

O mO 







CAVE 

2.3 0.4 

1.9 

3.8 

1.2 -3.0 

1.3 -2.4 

1.0 

2.6 

5.6 

CSCMA 

2.7 2.2 

2.3 

2.2 

1.8 3.4 

2.7 4.1 

1.7 

1.2 

2.4 

CSE 

C.7 0.6 

0.6 

0.6 

8.6 1.1 

0. 9 1.3 

0.3 

U«4 

0.8 

CAVSE 

3.1 C.6 

3.0 

3.9 

2. 1 -4.6 

1.6 -l.C 

1.8 

7.0 

7.3 

CAVKS 

4.3 0.8 

3.0 

6.1 

2.7-11.3 

2.7 -3.: 

1.8 

4.7 

8.6 


AVE SO SE 

••6«440IFF.FRaM( 7S78I444444 
SO SE AV/SE 

PRCNT. 

IMPACT 

54.03 

8.66 

2.61 

0.0 

0.0 

0.0 

0.0 

0.0 

53.84 

7.13 

2.16 

0.19 

3.26 

0.98 

0.19 

O.JiS 

50.00 

5.72 

2.86 

2.34 

2.26 

1.13 

2.C7 

4.34 

33.10 

10.58 

3. 19 

0.93 

6.49 

1.96 

0.47 

1.72 

53.43 

6.87 

2.07 

0.38 

3.63 

1.10 

0.33 

1.07 

32.71 

7.88 

2.37 

1.32 

1.63 

0.49 

2.69 

2.44 

3S.43 

6.33 

1.91 

1.60 

3.81 

I.IS 

1.39 

2.96 

32.36 

8.69 

2.62 

1.67 

3.93 

1.19 

1.40 

3^09 

3 1.79 

9.09 

2.74 

2.24 

4.27 

1.29 

1.74 

4.14 

32.03 

9.41 

2.64 

1.98 

3.44 

1 .04 

1.91 

3.66 

33.93 

9.25 

2.79 

0.07 

1.74 

0.33 

0. 14 

0.14 

48.94 

0.62 

0.36 

0.26 

1.14 

0.66 

0.40 

0.49 

5 1.78 

9.30 

2.81 

2.23 

4.29 

1 .29 

1.74 

4.16 

32.77 

4.77 

2.39 

-0.4 2 

2.32 

1.16 

-0.36 

-0.77 
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Table 39h. t 2 hr. zsoo skill score irpact on eurcpe 


EXP 
7! 78 

S/1 

5S.3 

2/3 

58.4 

2/5 
59 .9 

2/7 

77.3 

S/9 2/11 2/13 
5C.6 53.2 63.7 

2/15 2/17 
71.5 51.6 

2/19 

<5.9 

2/21 

75.3 

••••••EXPERIMENT •• ••• 

AVE SO SC 

62.06 9.47 2.86 

••4***0IPP.PR0MI 7S76>****** 

A-VE SO SE AV/SE 

0.0 0.0 0.0 0.0 

PRC NT. 
IMPACT 

0.0 

82*0 

-2.2 

-1.0 

-0.5 

2.4 

0*3 “^*8 

0.2 -4.7 

1.0 

6.4 

62.45 

7.70 

2.32 

-0.39 

3.16 

0.95 

-0.41 

-0.63 

E497 

C.l 

-7.2 

2.3 

11.1* 




• ••• 

6 1.18 

5.58 

2.79 

1 .55 

7.53 

3.77 

0.41 

2.49 

8JI0 

-1.3 

9.1 

-8.2 

9.9 

3.8 -8.2 -5.1- 

11.3 -9.6 

2.5 

7.9 

63.02 

9.94 

3.00 

-0.95 

7.99 

2.41 

-0.40 

-1.54 

E252 

-C.8 

-2.5 

-1.0 

7.8 

-0.6 -6.4 -0.5 

1.1-10.8 

2.5 

3.7 

62.74 

6.17 

1.86 

-0.68 

4.93 

1.49 

-0.45 

-1.09 

84 OS 

-0.6 

3.1 

1 .4 

4.2 

-2.5 1.4 1..4 

1.9 -2.4 

1.2 

2.8 

6 1.0 2 

7.93 

2.39 

1.04 

2. 13 

0.64 

1 .63 

1 .68 

E447 

2.3 

0.2 

8.2 

6.7 

-C.4 -?4.6 -1.9 

2.9 -6.2 

6.9 

5.9 

60.06 

7.26 

2. 19 

2.00 

5.08 

1.53 

1 .30 

3.22 

84 72 

C.2 

0.2 

-0.4 

9.2 

6.6 -2.9 0.0 

-3.7 -7.9 

2. 1 

1 .2 

61.10 

9.50 

2. 86 

0.97 

4.97 

1.50 

0.65 

1.56 

85 45 

1.5 

1 .3 

1 .8 

9.9 

5.6 -3.9 3.8 

—3.4 C.9 

7.0 

3.3 

59.53 

8.90 

2. 68 

2 .54 

A - • H 


2.04 

4.09 










1 .25 

8566 

3.4 

1.4 

1 .7 

8.8 

5.8 -3.5 2.9 

-3.6 -1.3 

1.6 

3.1 

60.23 

9.15 

2.76 

1.84 

3.69 

l.l 1 

1 .65 

2.96 

8574 

-2.8 -1.3 

-2.7 

0.1 

3.1 -0.6 -0.5 

0.3 0.0 

3.3 

1 .7 

62.00 

9.30 

2.80 

0.07 

2.02 

0.61 

O.ll 

O.ll 

8581 

-4.5 -0.4 

-2.84 





• **• 

60.43 

2.06 

1. 19 

-2.57 

2.06 

1.19 

-2. IS 

-4.14 

8593 

3.4 

2.5 

2.1 

9.2 

7.5 -4.0 4.6 

-2.8 -1.4 

3.9 

1.9 

59.61 

9.39 

2.83 

2.45 

4.04 

1.22 

2.01 

3.95 

8695 -0.5 ' 

-6.1 ' 

-0.8 


62.92 

6.29 

3.15 

-0.19 

5.22 

2.61 

-0.C7 

-0.31 

CAVE 

0.3 

-0. 1 

C.l 

7.2 

2.8 -3.2 -0.0 

-l.C -4.3 

3.4 

3.8 









OSCMA 

2.8 

-».9 

2.6 

3.2 

3.5 2.8 3.1 

3.9 3.9 

2.5 

2.1 

c c 







CSE 

0.8 

1.1 

1.0 

0.9 

1.1 C.9 1.0 

1.2 1.2 

0.8 

0.7 









CAVSE 

0.4 

-0.0 

C.l 

7.7 

2.5 -3.7 -0.0 

-l.e -3.5 

4.4 

5.7 

•V c 







CAVNS 

0.6 

-0. 1 

c .2 

9.3 

5.5 -C.l -C.l 

-2.6 - 8.4 

5.2 

5.0 









3-150 




Irible 391. «a hr. slp rms impact or north America 


EXP S/I 

2/3 2/S 

2/7 

2/9 2/11 

2/13 

2/15 

2/17 2/19 

2/21 

TS78 T.a 

9.6 10.2 

10.4 

11.1 7.4 

7.3 

5.9 

5.9 7.5 

7.3 

azAO -0.3 

0.6 -0.2 

1.0 

-0.3 0.4 

1 .3 

-0.5 

-C.O -0.1 

0.7 

E497 0.4 

2.5 -0.1 


0310 -0.3 

1.5 -1 .0 

2.7 

2.4 0.5 

1.3 

0.3 

-C.2 -0.4 

-0.0 

0352 -0.2 

2.6 -0.3 

2.0 

0.9 0.3 

1.5 

1.0 

0.7 -0.7 

0.1 

04 CS -0.2 

0.5 -0.9 

0.7 

0.1 -0.4 

0.6 

0.1 

-1.0 -1.0 

0.3 

0447 0.1 

2.7 -0-3 

2.6 

1.1 -0.2 

1.4 

-0.2 

0.3 -0.6 

-1.6 

i fZ -0.2 

1.5 0.1 

2.3 

2.6 0.5 

l.l 

-0.2 

0.2 -1.5 

-0.0 

0545 -0.1 

2.1 -0.3 

2.6 

2.0 0.9 

1.7 

0.1 

0.3 -0.4 

O.e 

0566 -0.3 

2.7 0.1 

1.7 

• 

til 

O 

• 

1.0 

1.0 

-0.4 1.4 

0.5 

E574 -0.4 

1.2 1.0 

1.3 

1.6 -0.4 

1.0 

1.8 

C.7 0.444444 

0501 0.4 ' 


0593 -0.1 

1 *0 *6 

2.0 

2.9 1.3 

1 .7 

l.l 

0.0 -0.1 

0.6 

E695 0.0 -0.3 0.4 


CAVE -0.1 

1.4 -0.3 

1.6 

1.6 0.4 

1.3 

o.e 

0.1 -0.3 

0.1 

CSGMA 0.2 

1.2 0.7 

1.0 

l.l 0.5 

0.3 

0.7 

0.5 0.7 

0.0 

CSC 0.1 

0.3 0.2 

0.3 

0.3 0.2 

0.1 

0.2 

0.2 0.2 

0.3 

CAVSC -1.3 

4. 1 - 1.6 

5.6 

4.7 2.2 

12.0 

2. 1 

0.0 -1.3 

0.3 

CAVNS -1.1 

14. S -3. 1 

1 5.4 

14.9 4.9 

17.4 

7.7 

2.3 -4.2 

1.0 


••t.*!*®*'’*^?****'^***** •••••*OIRP.FRO«<?570>*RA*R* RRCNT. 

SE AVe SO SE STSfC IMPACT 


C.24 

1.03 

O.fS 

0.0 

0.0 

0.0 

0.0 

0.0 

7.99 

1 .86 

0.56 

0.25 

C.60 

0.10 

1.30 

3.05 

9.11 

2.24 

1.12 

0.43 

1.51 

0.76 

0.57 

5.22 

o 

K 

• 

1.56 

0.47 

0.w4 

1.26 

0.38 

1.43 

6.61 

7.52 

1.04 

0.55 

0.72 

1.03 

0.31 

2.31 

0.69 

0.35 

1.75 

0.03 

-0.11 

0.63 

0.19 

-O.EO 

-1.29 

7.75 

1 .62 

0.49 

0.49 

1.35 

0.41 

1.20 

5.90 

7.66 

1 .35 

0.41 

0.50 

1.20 

0.36 

1.02 

7.09 

7.29 

1.43 

0.41 

0.95 

1.16 

0.33 

2.0C 

11.50 

7.26 

1.76 

0.49 

0.90 

1.03 

7.20 

3.44 

11.00 

7.51 

1 .01 

0.57 

0.02 

0.75 

0.24 

3.47 

9.99 

10.24 

2.53 

1.46 

-1 .05 

1.27 

0.74 

-1.42 

-12.70 

7.21 

1.70 

0.54 

1.03 

1.05 

0.32 

3.24 

12.50 

9.04 

0.97 

0.40 

0.50 

e.93 

0.46 

1.00 

6.07 


l^le 39j 


72 hr. SLR RRS INPACT ON RCRTM AM6ICICA 


exR 

7S78 

6240 

(407 

SJIO 

8352 

8405 

8447 

84 72 

8545 

8566 

8574 

8581 

8593 

8695 

CAVE 

CSCNA 

CSE 

CAvse 

CAVNS 


2/1 

10.1 

2/3 2/5 2/7 

12.3 10.3 11.4 

2/9 

13.3 

2/11 

11.0 

2/13 

7.0 

2/15 2/17 

4.2 6.8 

2/19 2/21 
10.0 9.5 

/«£ SO SC 

9.62 2.67 0.81 

••♦•••OIRP.RRORI 7578I646446 

AVC SO S6 ST8I0 

0.0 0.0 0.0 o.c 

PRCNT. 

IMPACT 

0.0 

0.7 
1 .9 

-0.2 0.2 0.3 

1.3 -0.2 -l.3< 

-0.0 

2.3 

1.0 

-1.5 -0.1 

1.3 -0.9 

9.34 

1 0.60 

2.48 
1 .89 

0.75 

0.94 

0.27 

1.05 

C.32 

0.86 

2.82 






0.42 

1.46 

0.73 

0.58 

4.39 

0.1 

2.6 -0.1 -0.4 

3.6 

3.5 

0.4 

-l.l -0.5 

0.4 -o.e 

8.90 

1.97 

0.59 

0.71 

1.71 

o.st 

1.39 

7.42 

-1.8 

2.2 0.2 -1.5 

2.2 

2.8 

0.7 

-0.1 0.7 

• 

1.5 -0.5 

9.04 

2.65 

0.80 

0.57 

1.50 

0.45 

1.27 

5.98 

-1.4 

1.2 -1 .0 -0.5 

0. 1 

-0.7 

0.5 

-1.0 -2.1 

1.5 0.4 

s.e" 

2.49 

0.75 

-0.28 

1. 12 

0.34 

-0.82 

-2.87 

-C.4 

1.6 0.4 -0.9 

2.7 

2*1 

0.9 

-1.0 -C.O 

1.3 -2.2 

9.21 

2.34 

0.70 

0.4 1 

1.49 

0.45 

0.91 

4.22 

-0.3 

2.3 -0.0 -0.5 

3.3 

1.8 

0.3 

-0.4 -C.l 

-0.9 -1.0 

9.21 

2.21 

0.67 

0.4 1 

1.43 

0.43 

0.95 

4.25 

0.9 

3.1 -0.6 -1.0 

3. 1 

1.2 

1.1 

-0.8 -0.3 

0.6 0.9 

8.86 

2.16 

0.62 

0.75 

1.38 

0.40 

1.89 

7.83 

0.6 

4.0 -1 .5 -2.4 

3.9 

2.7 

0.8 

-0.8 -1.2 

3.2 2.4 

8.55 

2.49 

0.69 

1.06 

2.14 

0.59 

1.79 

11.07 

-1.5 

0.2 -0.3 -2.1 

2.1 

-1.7 

1.5 

-1.1 C.5 


9.68 

3.13 

0.99 

-0.05 

1.55 

0.49 

-O.IC 

-0.50 

>0.4 


1 1.54 

1 .02 

0.59 

-0.64 

0.60 

0.35 

-1.86 

—6.69 

1.3 

3.1 -0.5 -1.9 

3.5 

1.5 

1 .2 

-0.8 C.2 

0.7 1.2 

6.76 

2.36 

0.71 

0.8fi 

1.60 

0.48 

1.77 

8.88 

0.8 


1 1.05 

1 .99 

0.99 

-Or 02 

1.04 

0.52 

-0.C4 

-0.23 


0.0 

1.6 

-0.3 

-1.1 

2.5 

1.5 

0.8 

-0.9 

-C.3 

1.1 -C.l 


1.1 

1.4 

0.7 

0.8 

1.3 

I.S 

C.4 

0.4 

0.8 

1.0 

1.3 


0.3 

0.4 

C.2 

0.2 

0.4 

c.s 

0. 1 

0. 1 

0.2 

0.3 

C.4 


0.1 

4.0 

-1.6 

-5. 1 

5.8 

3.2 

7.3 

-7.1 

-1.2 

3.6 -0.1 


0.3 

12.8 

-2.8 

-9.7 

18. S 

14.0 

1 1.9-20.8 

-4.4 

11. S -C.S 


3-152 


T^ble 39k. 48 mr, 2900 rms impact or north America 


EXP 

7978 

2/1 2/3 2/5 2/7 2/9 2/11 2/13 2/19 

64.8 63.8 99.7101.6102.0 CS.3 83.4 97.9 

2/17 2/19 
97.6 77.8 

2/21 

83.8 

•*****EXPERIMENT***** 

AVE SO SE 

77.94 17.44 5.26 

••••••OlfP.PROMI 7970)*4*4*4 

ave so <e stsic 

0.0 0.0 0.0 O.C 

PRCNT. 

IMPACT 

0.0 

8240 

8497 

0.8 -2.4 5.0 9.0 -4.0 -6.5 16.9 0.2 

9.5 -0.3 

2.9 

79.47 

90.56 

16.78 

36.65 

9.04 

2.46 

6.55 

1.97 

1.29 

3.16 





lb • J J 

—8 . 09 

16.74 

8.37 

-C.97 -10.38 

8310 

12.0 12.5 -4.8 

17.3 26.6 -9.8 19.4 6.2 

0.2 -1.4 

-1.1 

7 1.29 

17.02 

9.13 

6.65 

1 1.05 

3.33 

1.99 

8.93 

8JS2 

12.3 9.5 3.3 

15.6 16.0 -6.1 23.6 5.3 

5.8 -0.1 

5.6 

69.67 

16.26 

4.90 

8.26 

8.29 

2.50 

3.31 

10.60 

84CS 

3.2 -0.9 2.4 

4.6 1.4 1.8 5.6 -4.1 

8.4 -7.9 

-1.3 

76.72 

1 7.97 

5.30 

1.21 

4.58 

1-38 

0.88 

1.95 

8447 

8.0 9.8 -8.3 

19.3 19.1 -6.1 25.8-19.1 

0.3 -5.2 

12.5 

72.82 

16.49 

4.97 

5.1 1 

12.87 

3.88 

1.32 

6.56 

■ 472 

8.0 8.9 1.9 

7.3 21.9 -6.0 27.6 11.6 

-7.1-10.3 

4.9 

7 1.72 

1 7.53 

5.29 

6.21 

1 1.69 

3.52 

1.76 

r.97 

• 545 

9.3 13.4 -2.8 

15.4 26.9 7.3 31.7 -0.4 

-2.2 -0.6 

4.8 

68.92 

15.78 

4.99 

9.02 

11.92 

3.33 

2.71 

11.97 

8566 

1.4 6.3 7.5 

12.0 25.3 -2.8 8.3 -6.0 

-4.6 16.4 

-8.0 

72.89 

12.65 

3.65 

5.09 

9.97 

2.88 

1.77 

6.53 

8574 

5.3 -5.7 4 .3 

12.0 18.7 -0.4 26.8 -4.1 

-1.7 7.0***«* 

7 1.32 

13.92 

4.40 

6.03 

10.19 

3.21 

1.88 

7.73 

8581 

1.8-18.8-32.9* 




92.72 

35.88 

2‘J.71 - 

16.62 

1 7.44 

10.07 

-1.49 - 

21.33 

85 9J 

9.8 12.7 -9.9 

8.9 22.0 9.2 30.8 7.4 

C.9 3.3 

6.0 

69.11 

19.53 

5.89 

8.83 

10.67 

3.22 

2.74 

11.33 


92.62 

19.89 

9.94 - 

10.15 

4.89 

2.49 

- 4 . 1 a - 

13.02 

CAVE 

3.7 3.9 -4.8 

7.6 16.8 -2.3 21.3 0.1 

0.6 0.1 

2.9 









OSCMA 

7.2 9.7 1C. 7 

11.9 10.0 9.4 8.7 7.4 

4.6 7.3 

9.5 









CSE 

2.0 2.7 3.0 

3.4 3.2 l'.7 2.8 2.4 

1.5 2.3 

1.8 









CAVSE 

1.9 1.9 - 1.6 

2.2 5.3 - 1.4 7.7 O.C 

0.4 0.0 

1.6 









CAVNS 

9.8 6. 1 -4.8 

7.9 16.9 - 4.6 29.5 0.2 

1.0 0.1 

3.5 










3-153 


^^3bl6 391» HR« 290C RMS IMPACf OK NORTH AMCRtCA 


EXP 


EAST -9.2 S.O -0.6-35.24 


SS0|oJ3.2-|9.|-26, 


0695-19.6-24.6 -5.7 -I, 


2/11 

2/13 2/19 2/17 

S/19 

2/21 

•••444EXPERIMCNT66446 

OVE SO SE 

SO SE STsic 

74.4 

70.9 60.3 96.3 

99.9 

90.0 

93.79 

26.03 

7.09 

0.0 

0.0 

0.0 

O.C 

12.9 

12.7 -9.9 0.1 

14. 1 

-9.0 

94.15 

20.91 

0.72 

-0.4 1 

11.32 

3.41 

-0.12 

• ••• 


»«••• 


116.07 

26.37 

13. 10 -10.02 

17.79 

0 .90 

-1.13 

2.6 

1 1 .4 -9.9 1.9 

2.7 

3.6 

06.12 

21.99 

6.91 

5.63 

11.60 

3.92 

1.60 

I.C3 

0.0 

16.3 -1.4 -C.2 

6.9 

-l.l 

90.50 

23.99 

7.22 

3.29 

1C. 49 

3.16 

-7.6 

7. 9-10. 9 0.0 

1*6 

1.9 

99.25 

25.56 

7.71 

-1 .90 

6.27 

1 .09 

-0.79 

10.9 

17.4 -4.2-IS.3 

26.4 

-0.6 

00.13 

22.69 

6.90 

9.61 

13.31 

4.01 

1 .40 

-7.0 

20.5 10.9 -6.3 

-0.6 

7.4 

oc.oo 

33.01 

10.20 

13.66 

23.92 

7.09 

1.93 

-4.9 

26.4 -3.7-14.0 

1.2 

20.0 

06.27 

23.13 

6.60 

5.40 

17.26 

4.90 

1. 10 

23.0 

-6.9 -2.6-19.0 

31.0 

19.4 

69.00 

1 9.94 

9.76 

10.74 

19.26 

9.56 

1.99 

ic«e 

19.5 -0.7 -6.4 

I6.94«* «• 

92.62 

25.97 

0.21 

1.90 

12.43 


0.30 





U 1 • / 0 

15.99 

9.23 - 

26.12 

7.02 

4.09 

-6.44 - 

"0m6 

26.4 1.9 -9.4 

-1.7 

19.6 

07.33 

29.35 

7.64 

6.41 

1 7.41 

9.29 

1.22 





120.02 

19.60 

9.04 - 

11.97 

te.36 

9.10 

-2.31 - 


CAVE 

-7.4 

10.0 -S. 1 

1.9 

10.9 

-C.7 

IS. 6 -2.6 

-6. 1 

9.0 

6.7 

OSCMA 

23.4 

20.6 

7.9 

12.3 

13.4 

1C. 5 

10.0 

S.6 

6.3 

12.1 

IC.I 

CSE 

6.5 

:.6 

2. 1 

3.: 

4.2 

3.3 

3.2 

1.6 

2.6 

3.0 

3.4 

C4VSE 

-l.l 

1.7 -i.9 

C.9 

4.4 

-C.2 

4.9 -1.1 

-2.3 

2.4 

2.0 

CAVNS 

-9.2 

0.4 - 4. 4 

1.6 

13.6 

-1.0 

22.0 -3.1- 

IC.O 

9.0 

7.4 


o o 

iB 

w > 

o ^ 

9 ^ 


PRCNT. 

impact 

0.0 

-0.43 

-10.69 

6.00 

3.47 

-I .00 

9.99 

14.97 

6.04 

11.46 

I .60 

27.06 

6.04 

12.77 


1 '. 
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l^le 39m. 

48 HU. SLP RMS impact 

OA EURCPE 









exi: 

79TB 

2/1 

S .2 

2/3 

8.5 

2/S 

7.7 

2/7 2/9 2/11 

7.4 7.7 7.0 

2/13 

9.0 

2/15 

8.8 

2/17 

5.6 

2/19 2/21 
6.2 11.9 

•••66*eXPERlMENT66666 

8VE so SE 

7.73 1.86 0.86 

66*66601 8 F . FIION ( 7878|686686 

AVE so SE STSIO 

0.0 0.0 0.0 o.c 

RRCNT. 

IMPACT 

0.0 

C 240 

- 0.4 

0.4 

1 .4 

0.9 - 0.4 - 0.7 

* 0.0 

0.1 

0.4 

0*0 0*4 

7.48 

1 .90 

0.57 

0.25 

0.64 

0.19 

1.31 

3.28 

e««7 

1.0 

0.7 

2.1 






6.22 

1 .61 

0.81 

0.98 

0.82 

0.41 

2.40 

12.74 

8310 

0.8 

2.8 

1 .4 

1.6 C.O -0.7 

0.7 

0.1 

1.0 

0.2 - 1.6 

7.15 

2.55 

0.77 

0.58 

1.17 

0.35 

1.63 

7.48 

8352 

- 0.6 

0.3 

1.4 

0.9 - e .2 - 0.4 

O.S 

1.1 

0.4 

0.9 - O.S 

7.37 

2.01 

0.61 

0.36 

0.70 

0.21 

1.71 

4.67 

8 « 0 S 

- 0.1 

0.3 

0 .9 

0.5 - O.'l - 0.4 

- 0.1 

0.1 

0.5 

O.S - 0.4 

7.57 

2.06 

0.62 

0.16 

0.43 

0.13 

1.24 

2.07 

8447 

0.1 

1 .0 

- 2.8 

1.1 -1.2 -0.7 

1 .8 

1.5 

0.3 

0.1 0.2 

7.61 

2.07 

0.62 

0.12 

1.32 

0 . 4 C 

0.30 

1.58 

8472 

0.5 

1.4 

1 .8 

1.0 - 0.8 0.0 

0.0 

0.2 

1.6 

- 0.2 1.3 

7.12 

1 .94 

0.58 

0.62 

0.84 

0.25 

2.44 

7.98 

8545 

0.2 

1.7 

1 .6 

0.9 - 2.8 - 0.0 

1.0 

- 0.1 

1.7 

0.2 0.2 

7.32 

3.09 

0 .86 

0.42 

1.17 

0.33 

1.28 

5.38 

8566 

0.1 

2.3 

2.2 

1.6 0.4 O.S 

2.1 

1.1 

- 0.4 

2.3 - 0.1 

6.64 

3.69 

1.02 

1.09 

1.04 

0.29 

3.78 

14.15 

8574 

- 0.6 

- 0.9 - 0.3 - 0.9 - 0.6 0.6 

0.6 

1.0 

- 0.5 


7.51 

1 .24 

0.39 

- 0.19 

0.68 

0.22 

-0.88 

-2.46 

8581 


1 .84 






8.83 

1 .48 

0.85 













0.29 

1.38 

0.79 

0.37 

3.75 

8553 

0.8 

2.0 

1 .5 

1.9 - 1.3 - 0.4 

O.S 

0.6 

1.6 

0.1 - O.S 

7.12 

2.39 

0.72 

0.61 

1.09 

0.33 

1 .86 

7.88 

8695 

0*0 

0.2 

0.5 






6.97 

1 .30 

0.65 

0.23 

0.22 

0.11 

2.12 

2.97 

OAVE 

0.1 

0.9 

1.0 

0.8 - 0.7 - C .2 

0.7 

o.c 

0.7 

O.S - 0.1 









OS CM A 

0.6 

1.0 

1.3 

C .7 C .9 C.S 

0.7 

O.S 

0.7 

0.7 0.8 









CSc 

0.2 

0 . 3 

C.4 

0.2 0.3 C.l 

C.2 

0.2 

0.2 

0.2 0.3 









CAVSE 

0.4 

3.3 

S.9 

3.9 - 2 .S - 1.5 

3.2 

3.3 

2.8 

2.2 - 0.4 









CAVNS 

1.1 

1 1.0 

1 3.5 

11.1 - 8.9 - 3.2 

7.8 

6.4 

( 1.7 

7.8 -0.9 










T^le 39n 


72 HR. SLR RMS IMPACT Oh EUROPE 


EXP 

2/1 

2/3 

2/9 

2/7 2/9 

2/11 

2/13 

2/19 

2/17 

2/19 2/21 

•••OROEXPERIAENroOOOO 

• VE SO SE 

OVE SO SE STsio 

PRCNT. 

IMPACT 

7S7S 

6*4 

S«6 
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4.3 

US 

C.C 

-C.2 
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•feble 39o. z-oo rms impact 


OK EURCPE 


i«P i/I 2/3 2/9 2/7 2/« 2/11 2/13 2/IS 

7572 93.1 96.0 70.6 02.1 «7.A 42.0 76.7111.6 

8240 -3.0 0.0 0.2 0.3 -t. 1-10.6 -7.2 -1.7 
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4444444444444 90.40 9.92 2.76 
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9.0 
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-4.3 
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62.69 
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-0.3 
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0.9 6.1 
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-0.6 
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cse 1.0 2.S 2.9 2.1 2.9 2.4 3.3 2.2 I.o 2.0 2.6 
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9.13 
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Table 39p. 
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Table 40. 

Average/ standard 

error for 

skill 

scores . 
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NA 

Z5Q0 

72 

SLP 

72 

EB 
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43 72 

total 

7578 
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0.0 

0.0 

0.0 
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0.13 
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1.07 
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8210 

0.89 
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0.37 
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-0.64 
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8472 

C.7C 

0.45 
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1 .96 

2. 
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1.92 
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1 .95 
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1.94 
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1 .74 

1.9 1 
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1.31 
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1 
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Table 41 . 


SLP 


NA 


Summary of percent impact 

Z500 SLP 


for skill scores. 

£R 

zsoo 


EXPEK 

48 

72 

4£ 

72 

7S7d 

C.O 

0.0 

C.C 

0.0 

8£4C 

C.C9 

0.94 

0.£3 

-l.ll 

849T« 

2.46 

-1.55 

-6.39 

-1 .93 

8310 

£.4 1 

1.95 

3. £7 

5.17 

63S2 

3.09 

1.13 

4 .CO 

2.11 

8405 

0.49 

-1.26 

-C.32 

-0.43 

£447 

1.07 

0.-76 

3.48 

5.23 

£472 

1.9C 

1-54 

2. £8 

4.69 

8S4S 

4.25 

5.06 

4. £6 

6.25 

8566 

4.5 1 

5.86 

4 .£2 

7.34 

£574 

3.oe 

2.58 

l.£9 

1.47 

8531* 

- 1.6£ 

0.43 

0.56 

1 .36 

8593 

4.7c 

S.£€ 

4,47 

6.08 

£695* 

-0.23 

0,73 

-5.C5 

-4.79 


» - INCOMPLETE 


43 

72 

48 

72 


C.O 

0.0 

0.0 

0.0 

C.O 

0.45 

0.S4 

0.35 

-0.63 

0.21 

£.55 

5.60 

4.34 

2.49 

1.45 

4.00 

4.44 

1.72 

-1.54 

2.75 

1.69 

2.62 

1.07 

-1.09 

1.83 

2.35 

2.81 

2.44 

1.68 

C.97 

£ .54 

4.57 

£.96 

3.22 

2.98 

4. '53 

4.71 

3.09 

1.56 

3.11 

4 .43 

4 .88 

4.14 

4.09 

4.74 

3.15 

3.40 

3.6b 

2.96 

4.46 

C.64 

1.18 

0.14 

0.11 

1.20 

£.85 

4.00 

0.49 

-4. 14 

0.87 

4.43 

3.72 

4.16 

3.95 

4.79 

3.49 

4.30 

-0.77 

-0.31 

-0.33 


Tables 39i-39p; these are the analogs of Tables 27b, 28b, 29b, 

30b, 31b, 32b, 33b, 34b given for DST-5. Table 40 presents our 
rough measure of statistical significance for the results. Its 
entries were computed in the same way as those of Table 36 of the 
previous _.jsection. Table 41 is analogous to Table 35 of that 
Subsection and contains the mean percentual skill score impacts for 
each experiment. 

Before discussing the results, it is important to remember 
that Experiment 8405 is a control experiment, as described in Subsection 
3. 3. 1.3, and that all the results have to be gauged against those 
of Experiment 8405. We notice first in Table 40 that the measure 
of statistical significance for Experiment 8405 is 1.07. Hence 
the results of the DIM experiment 8240, with 0.13, have no con- 

fidence whatever attached to them (also Ci< 0 . 5 ), while those of the 
SCM experiments 8310, 8352, and 8447, with ^3 = 0.94, = 1.01, and 

Cg = 1.36 respectively, can oe considered as marginally significant: 

^3 = ^4 = 1 " ^6 • 

The corresponding mean percentual impacts from Table 41 are x =0.97 

5 

for the control experiment 8405, and x^ = 0.21 for the DIM experiment 
8240, which is practically negligible; they are x, = 2.75, x =1.83 
and Xg = 2.98 for the SCM experiments 8310, 8352, and 8447 respectively 
wxth Xg = X 3 = 1.5x^, x^ = 2}Cg. We already notice a strong correla- 
tion between measure of impact and measure of confidence. Moreover, the 

control experiment shows that the DIM experiment totally failed to 
produce favorable impacts, while the SCM experiments produced results 
considerably better than the performance level set by the control 
experiment, in fact twice as good, at least. Also Experiment 8310, 
which used a larger amount of data, obtained from two satellites, 
produced results which were 50 percent better in mean percentual 
impact than those of Experiment 8352, utilizing the same assimilation 
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method (SCM) but data from NIMBUS -6 only. Furthermore, Experiment 
8447, in which no satellite data were inserted over land, reflecting 
higher reliance on conventional data, produced results comparable to 

and even better than those of Experiment 8310, while using only data from 
one satellite (NIMBUS 6 ) . 

We proceed now to discuss the SAM experiments, 8472 through 8695, 
i.e., 7 < i < 13, omitting, however, the incomplete ones, 8581 and 
8695. The comparison of results, in both impact and significance, of 
Experiment 8574, i=10, which used only NOAA-4 data. Experiment 8472, 
i=7, which used the more abundant NIMBUS -6 data, and the remaining 
SAM experiments, 8545, 8566, and 8593, i = 8 , 9, and 12, which used 
data from both satellites, immediately shows the importance of data 
quantity, independently of the assimilation method. We have in fact 

0.66 < = 1-39 < C j f j = 8 , 9, 12 with = 2? similarly 

Xio= 1.20 < x-y = 3.11 < Xj = 4.65. Thus Experiment 8472 is comparable 
to the best SCM experiment, 8310 or 8447, while Experiment 8574 pro- 
duces somewhat poorer results. 

The results of the three SAM experiments which utilized fully 
the available data, 8545, 8566, and 8593, are remarkably similar. 

We have ^3 = 1.94, Sg = 1.85, and ~ 2.05; these give us all high 
statistical confidence in the mean impacts, being very close to, and 
one even larger than, 2. The mean impacts are Xg = 4.74, Xg = 4.46, 
and xj ^2 4.79, that is close to 5 percent. This is certainly not 
a very large impact, but is quite comparable to improvements in 
numerical weather prediction which have been considered as important 
over the last decade; it corresponds approximately to the ability of 
making a 60 h forecast of accuracy which equals that of today ' s 
operational 48 h forecast (see for instance Chapter 1 of this report.) 
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We remark in passing that the attempts at removing the bias, 
either at observation point (8566), or at the correction point (8593), 
did not make much difference in the results. The use of SAM itself, 
however, certainly did make a difference. It is very interesting to 
consider the SCM experiment which is similar in other respects to the 
three SAM experiments we are in the process of discussing, namely 
Experiment 8310; we immediately notice that the two quantities 
measuring results, and x^, have a value which is almost exactly half 
the corresponding representative value for SAM, = 0.94, versus 
2, and X 3 = 2.75, versus 5. The values of and x^ for DIM experi- 
ment 8240 can be considered zero for all practical intents and 
purposes of this discussion. We observe at this point that, in a 
certain sense, SCM is a low-order approximation to SAM, in which the 
matrix A of Subsection 3. 2. 7. 2 is approximated by a diagonal matrix 
(compare Rutherford, 1972). 

The results for rms errors strongly support those presented 
here for skill scores; they are given in Tables 42 and 43: Table 

42 contains mean rms impacts and Table 43 gives their statistical 
significance. The statistical significance of the rms results is 
influenced by data quantity and assimilation method in the same way 
as the results, and so are the mean impacts; the values of rms 
mean impacts are of the order of 10 to 12 percent for the best SAM 
experiments, and 5 to 7 percent for the SCM experiments. 

Furthermore, differences in initial states correlate well with 
impact on forecasts from those initial states. Our statistical 
measures of impact also correlate v;ell with improvements in the 
capability of predicting local weather when using the large-scale 
numerically predicted fields for guidance (see Chapters 1 and 5 of 
this report) . 
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Table 42. Summary of percent impact for rms errors. 
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0.0 

0.0 
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0.0 
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3.16 -C.43 
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3.93 
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5.22 

4.39 
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5.72 
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20.03 
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6.61 

7.42 

6.53 6.00 

7.48 
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0.53 
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6.69 

5.96 

1C.6C 3.47 

4.67 

3.99 

6.89 
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6405 

-1.29 
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1.55 -1.60 
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3.32 
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5.90 
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1.58 

1.81 

12.54 

20.31 


6472 

7.C9 

4.25 

7.97 14.57 

7.96 

6.95 

-0.46 

-0.58 


8545 

11.56 

7.63 

11.57 5.64 

5.38 

1.66 

17. 1 4 

15.56 


6566 

11.68 

11.07 

6.53 11.46 

14.15 

9.98 

17.0C 

17.24 


65744 

9.99 

-0.50 

7.73 1.60 

-2.46 

-3.76 

9.21 

7.48 


856 1 4 

-12.70 

-6.69 

-21.33-27.86 

3.75 

7.26 

-11.29 

-8.17 

c o 

8593 

12.50 

8.88 

11.33 6.84 

7.88 

4.76 

14.64 

13.31 


66934 

6.C7 

-0.23 

-13.C2-12.77 

2.97 

-C.48 

-7.21 

-6.70 

y z 

w > 
^ r 


4 - INCOPPLETE 






s > 


O 

n 

K 


total 

0«0 

2.43 

6*43 

S.13 

6«31 

1«51 

7«3e 

5.97 

9«57 

12.41 

3.66 

-9.63 

10.02 

-3.92 
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Table 43. Statistical 


significance for rms errors. 

EUROPt 


exPER 

• n »« r « 

SJ_P 

48 72 

. #4 * r' 

2500 

48 72 

Sl-P 

48 72 

2500 

48 72 


TOTAL 

7578 

0«C 

0.0 

C.C 

C.O 

0.0 

C.O 

0.0 

0.0 


0.0 

8240 

1.38 

0.86 

1.25 

-C.12 

1.31 

1.74 

0.62 

0.52 


0.94 

8497* 

O 

• 

in 

0.58 

-C.97 

-1. 13 

2.40 

1.03 

2.57 

1 .99 


0 .88 

6310 

1.43 

1 .39 

1.99 

1.60 

1.63 

-1.17 

1.92 

0.10 


1.11 

8352* 

2.31 

1.27 

3.31 

1.03 

1.71 

C.95 

1.67 

2.31 


1 .82 

8405 

-0.56 

-0.82 

C.88 

-C.79 

1.24 

1.69 

4. 35 

3.83 


1 .23 

8447 

1.20 

C.91 

1.32 

1.40 

C.30 

C.54 

2.61 

1 .63 


1.24 

8472 

1.62 

0.95 

1.76 

1.93 

2.44 

2.55 

-0. 1 0 

-0.17 


1 .37 

8545 

2.85 

t .89 

2.71 

1. 1 0 

1.28 

0.41 

3.54 

4.32 


2.26 

8566 

3. 44 

1.79 

1.77 

1.93 

3.78 

1.64 

2.93 

4.91 


2.77 

85744 

3. 47 

-0.10 

1.88 

C.38 

-C.88 

-0.86 

3.18 

2«42 


1.19 

858 14 

-1.42 

-1.86 

-1.65 

-6.44 

C.37 

C.82 

-1.54 

-4.77 


-2.06 

8593 

3.24 

1 .77 

2.74 

1.22 

1.86 

1.04 

3.33 

4.74 


2.49 

86954 

1.C8 -0.04 
4 - INCOMPLETE 

-4.15 

-2-31 

2.12 

-C.16 

-1.91 

-1 .65 

> > 
^ c 

— 0.88 
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This concludes the discussion of our DST-6 experiments, to 
the extent allowed by the framework of this report. 

3.^ OjNCLUSIONS and RECOMMENDATIONS (m. Ghii) 

During the 1976 Impact Test Project (April 1976 - April 1977), 
we have developed, tested and evaluated a number of methods for the 
four “dimensional (4— D) assimilation of satellite-derived temperature 
data. The methods were all local and time-continuous, using only 
data provided by satellites in a small interval of 10 minutes at 
a time. We applied a direct insertion method (DIM) , a successive 
correction method (SCM) , and a statistical assimilation method (SAM) 
to DST-5 and DST-6 data. 

The results of the DST-5 experiments were inconclusive. This 
is probably due to two causes: (1) the synoptic situation during 
that summer period, and (2) the fact that our methods at the time 
when the experiments were carried out had not been perfected. 

The results of the DST-6 experiments allow us to draw a number 
of conclusions: (1) satellite-derived temperature data can have a v/ 
modest, but consistently positive impact on numerical weather fore- 
casts, as verified over the continents of the Northern Hemisphere; 

(2) this impact is highly sensitive to the quantity of the data — a 
two-satellite system is superior to one satellite by an amount rough- 
ly proportional to the quantity of data transmitted; (3) the assim- 
ilation method plays a major role in the level of impact for the 
same data — direct insertion proved practically worthless, while 
SCM provided about half the impact obtained with SAM. 


3-165 


The impact for the best method and the best data was about 5 
percent in skill score and 12 percent in rms error; these cor- 
respond to an extension of about 8-121’ in the usefulness of oper- 
ational weather prediction (NWP) in the range between 48 h and 
72 h. There are indications that local weather forecasts using 
large-scale NWP results as guidance can be similarly improved. 

Our results seem to point to two major areas in which improve- 
ments can bring about larger impacts of asynoptic observing systems. 

The first is improving the accuracy of the observations themselves: 
in the presence of large errors (2-2. 5“C rms errors in vertical 
temperature profiles derived from satellite radiance data) , even as 
modest an impact as the one we obtained is surprising. The deficien- 
cies in data quality can only partially be compensated for by large 
data quantities and by processing and assimilation methods. There 
is furthermore a major need for continued development of the processing 
^sthods and of the assimilation methods themselves, and also of a much 
closer interaction between the processing of raw data and the assimila- 
tion of the processed data. 

The second area of improvement is in the numerical models them- 
selves: for the asynoptic data to be successfully assimilated and 
contribute thus to a better approximation of initial states, it is 
necessary that the model used in the assimilation process be able 
to convey the information present in the data accurately over ex- 
tended instances and periods of time. Model improvement can only 
proceed by a judicious combination of higher grid resolution, better 
numerical discreti 2 ation methods, and better representation in the 
model of atmospheric processes. 
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We hope that the concerted effort in designing better observa- 
tion instruments and systems, iii refining the methods for processing 
and assimilating the observations, and in developing numerical models, 
will bring about the improvement in numerical weather prediction 
and in our understanding of the atmosphere which is the goal of the 
Global Atmospheric Research Program. 
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FORECAST MODEL DEVELOPMENT 

(W. Quirk, Scientist; Y. Sud, Manager) 

A.l APPROACH 

From the start of this DST forecast impact project it was 
clear that the forecast models must be improved if satellite 
sounding data were to have its maximum impact. Current forecast 
models are of little operational use beyond 48 hours, however*, 
data has its -greatest impact on weather prediction 
forecasts of 48 hours and longer (see Chapter 3; Analysis and 
Assimilation) . Satellite data is of use primarily in defining 
the atmospheric state in data— sparse regions such as oceans, 
and by the time this weather influences conditions over popu- 
lated regions the forecasts have already greatly deteriorated. 

The deterioration of forecasts beyond 48 hours is believed to 
be due to three main causes: (1) forecast model inadequacies such 
as too coarse horizontal resolution, (2) the nonavailability of 
poor quality of data from certain regions, and (3) inadequate methods 
of data analysis and assimilation. Robert (1975) has estimated that 
almost 80 percent of the error in 36-hour forecasts comes from fore- 
cast model deficiencies, rather than errors in data. Since it is 
only at periods longer than 48 hours that satellite data become 
important for forecasts over populated areas, it is imperative to 
use better forecasting models. Only through a concentrated effort 
to improve all three areas can the most effective use be made of 
satellite data.. Only after the forecast models and methods of data 
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assimilation are imiproved and wayp are found of getting high-quality 
data over the entire globe will forecasts of a week or more be 
possible . 

During 1976, the model development group considered the problem 
of how best to improve the forecast skill of the GISS GCM in time 
for use during the DST Impact Test Project. A number of improvements 
were made to the model physics in the areas of parameterization of 
clouds, radiatxon, hydrology, snow accumulation, and the planetary 
boundary layer; but these improvements showed little affect on model 
forecasts. A fourth-order differencing scheme was successfully de- 
veloped and tested du-ring the early phases of the Impact Test 
Project. While this model was a definite improvement over the standard 
GISS second-order model, in the few forecast tests conducted, the model 
was still in its developmental stage and could not be used operational- 
ly. Among other disadvantages, it ran two times slower than the 
second-order model. By using smoothed leap-frog time differencing 
the fourth-order model now uses only about 20 percent more CPU time 
than the second-order model, and should be ready in the near future 
for future forecast impact tests. 

A decision was finally reached to develop a high resolution 
(ultrafine) 250 km grid version of the second-order model for use 
during the Impact Test Project. Preliminary results indicated 
the ultrafine model made substantially better forecasts than the 
fine model; for this reason a data assimilation and forecast experiment 
was initiated. However, as the final assimilation scheme was not 
fully tested with the fine model until late December, the ultrafine 
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test did not begin until early in January. The assimilation program 
proved to be extremely time consuming. New methods to speed up 
this program are being tried, but it still takes 6 hours to do 
one similated day for an assimilation and nearly 10 hours for fore- 
casts of 4 simulated days. Because of the large amount of computer 
time involved, only the No SAT assimilation run has been finished 
and analyzed. The satellite assimilation r-un is now in progress. 

^.2 DEVELOPMENT OF THE ULTRAFINE MODEL 

The current GISS Global Circulation Model (GCM) has a 
horizontal spacing of 4» in latitude by 5° in longitude; this 
grid yields horizontal resolution of about 400 km in 
midlatitudes. Theoretical studies (e.g., Grotjahn and O'Brien, 

1976) have shown that with this resolution wave-lengths about 
the size of synoptic systems are poorly represented by the 
finite differencing scheme. In the GCM these systems propagate 
much more slowly than in nature and they do not strengthen as 
much as the observed highs and lows. Robert (1975) has esti- 
mated that almost 40 percent of the error in 36-hour forecasts 
is attributed to insufficient horizontal resolution. 

NMC has developed the Limited Area Fine Mesh (LFM) model to 
increase its forecast skill without greatly increasing the computer 
time needed for a forecast. This model consists of a fine mesh 
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(200-k™ resolution, over the United States en^edded in the 
standard 400-h. grid. They have run the nodel for several 
years now and have found that about one-half the error in the 

propagation and deepening of low-pressure systems is eliminated 

by use Of the LFM model (Brown 1975, . The success of the LPM 
■nodal is also shown in the statistical scores for sea-land pres- 
sure and 500-mb forecasts shown in Tables 1 and 2. (These tables 
ware made available to us by Buane Cooley of NMC, . The numbers 
rn the columns headed by 6L PE give the SI shill scores produced 
by the 6-level Primitive Equation model (400-km grid, for the 
last 16 months. The first column gives the average 12-hour 
forecasts skill during each of 16 months for the PE model, the 
second column gives the same statistics for the LFH model. 

The average scores for the last 12 months are also given. 

the averages one can see that the improvement of the LFM 
over the PE in sea- level pressure skill is greatest at 48 hours. 
For the 500-mb skill the improvement is greatest at 24 hours, 
there is still substantial skill improvement at 48 hours. 

It is surprising that the LFM model oan make such good forecasts 
at 48 hours, given the smallness of the area that has a fine 
grid. NMC is now planning to implement a model with a hemi- 
spherio or global fine mesh so the time for which meaningful 
forecasts can be made will be extended. 

It is of interest to note that this effort on the part of 
NMC is simultaneous with the acquisition of three IBM 370/195 com- 
puters. The improvement of weather forecasting models at NMC 
historically has occurred with the acquisition of new computer 
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systems. Figure 1 (from Fawcett, 1977) shows that the 500-mb 
36-hour forecasts was greatly increased with the introduction of 
the barotropic model when the IBM 700 series was introduced, and the 
skill was greatly increased again with the introduction of the CDC 
6600 and the 6-level PE model. 
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Table 1. SEA LEVEL PRESSURE 


SI Comparisons of the GIj PE and LFM for the contiguous United States. 


12-hr 24-hr 

61. PE LFM 6L PE LFM BAR 


36-hr 48-hr 

~6L PE LFM 6L PE LFM 



Oct 

75 

37.9 

40.8 

47.5 

45.7 


56.0 

54.9 


_ 


Nov 

75 

37.7 

40.9 

46.2 

46.7 

- 

55.3 

55.4 




Dec 

75 

37.8 

39.7 

46.3 

47.5 


56.1 

55.4 

63.4 



Jan 

76 

36.8 

37.6 

45.4 

44.5 

- 

53.8 

54.0 

60.7 



Feb 

76 

40.0 

39.5 

49.3 

46.7 

- 

58.2 

55.3 

65.9 

62.9 


Mar 

76 

38.5 

37.7 

48.1 

44.7 

- 

57.4 

51.7 

66.8 

56.7 


Apr 

76 

39.2 

39.0 

46.4 

44.5 

- 

55.3 

51.7 

62.5 

59.8 


May 

76 

39.2 

38.6 

47.1 

45.0 


55.8 

51.9 

64.1 

58.6 


Jun 

76 

41.9 

40.0 

48.1 

46.6 

- 

56.5 

54.8 

63.0 

59.5 


Jul 

76 

42.6 

40.5 

47.0 

46.8 

- 

54.0 

53.9 

60.4 

58.4 


Aug 

76 

43.7 

41.4 

49.5 

47.1 

- 

55.2 

53.7 

61.5 

59.6 


Sep 

76 

43.5 

41.9 

51.8 

47.2 

- 

59.4 

52.8 

67.4 

60.7 


Oct 

76 

36.4 

37.2 

43.7 

42.0 


51.8 

49.4 

59.1 

57.2 


Nov 

76 

35.3 

37.5 

42.1 

43.5 

- 

49.2 

50.6 

55.2 

58.0 


Dec 

76 

38.6 

38.3 

45.7 

44.3 

- 

54.4 

52.0 

61.7 

59.0 


Jan 

77 

38.3 

37.6 

48.4 

45.8 

- 

56.3 

53.3 

63.3 

62.1 

Average 

Feb 

76 










to 

Jan 

77 

39.8 

39.1 

47.3 

45.4 


55.3 

52.6 

62.6 

59.4 
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Table 2. 500 MBS 


SI Comparisons of the 6L PE and LFM for the contiguous United States. 
The barotropic model {BAR) performance is included at 36 hours. 





12 

-hr 

24 

-hr 


36 

-hr 

48 

-hr 




6L PE 

LFM 

6L PE 

LFM 

BAR 1 

6L PE 

LFM 

6L PE 

LFM 


Oct 

75 

23.3 

18.7 

31.7 

25.5 

44.5 

38.7 

34.7 




Nov 

75 

21.9 

18.1 

29.4 

25.2 

- 

36.5 

33.8 

— 

— 


Dec 

75 

20.9 

16.4 

28.4 

22.8 

39.4 

35.1 

29.9 

40.1 

- 


Jan 

76 

20.6 

15.6 

26.9 

22.5 

37.6 

33.8 

30.5 

38.4 

- 


Feb 

76 

20.2 

15.7 

26.5 

21.2 

36.7 

32.0 

28,0 

37.3 

36.1 


Mar 

76 

19.7 

15.8 

26.8 

21.8 

37.8 

34.0 

28.8 

40.0 

34.2 


Apr 

76 

24.3 

21.0 

32.1 

27.7 

42.1 

40.6 

36.3 

47.3 

46.0 


May 

76 

24.9 

20.0 

31.4 

26.4 

42.8 

39.2 

34.6 

47.1 

42.0 


Jun 

76 

26.7 

22.3 

32.1 

28.1 

44.8 

37.6 

36.2 

43.5 

43.3 


Jul 

76 

26.8 

22.9 

31.7 

28.0 

42.4 

38.5 

34.6 

44.6 

42.2 


Aug 

76 

25.2 

22.1 

31.7 

27.5 

42.0 

38.2 

34.6 

44.7 

42.3 


Sep 

76 

23.6 

20.5 

29.9 

25.1 

43.8 

36.1 

32.7 

42.6 

39.2 


Oct 

76 

20.7 

18.0 

27.3 

23.5 

39.2 

32.9 

31.3 

38.7 

37.8 


Nov 

76 

19.6 

16.3 

25.3 

21.8 

33.9 

30.6 

28.9 

35.5 

35.5 


Dec 

76 

18.9 

15.0 

25.5 

20.2 

36.1 

31.3 

26.5 

36.8 

32.7 


Jan 

77 

20.6 

16.9 

28.4 

24.4 

40.3 

35.1 

31.7 

41.0 

38.4 

Average 

to 

Feb 

Jan 

76 

77 

22.6 

18.9 

29.1 

24.6 

40.2 

35.5 

32.0 

41.6 

39.1 


This points out the way that improvements in computing technology 
have gone hand in hand with the improvement of weather forecasts. 


Because of the importance of long-term forecasts, accuracy 
for sounding impact development of a high-resolution GISS GCM 
model was given a high priority. The new model, called ultra- 
fine, has a resolution of 2.5° in latitude by 3° in longitude. 
Until the 1976 Impact Test Project, development of this model 
had not gone forward because of the limited computing resources. 
Only recently, with the addition of the ?iMDAHL computer dedicated 


4-7 


to the Global Atmospheric Research Programme (GARP) and the 
concentration of all resources on this effort, were we able to 
perform a limited number of high-resolution experiments. 

Three major efforts in the development of the high-resolution 
model were performed during the Impact Test Project. First, a 
coding effort was required to reduce the core requirements for 
the model to run on the AMDAHL computer. Second, numerical tech- 
niques were developed to minimize finite amplitude stationary 
computational instabilities (e.g., checkerboard tendencies in 
the pressure fields) . Both of these tasks were completed by 
June 1976, and limited forecast tests were carried out with 
summer DST data sets using the new high-resolution model. Third, 
a new topography had to be created for the ultrafine grid. 

The model used for the DST experiments was somewhat different 
from the version described by Somerville et al. (1974). In this 
version, the numerical differencing near the poles was modified 
to obtain a nearly equal area mesh near the poles using the split 
grid technique described by Halem and Russell (1973) . The use of 
the split grid technique allowed the model's time step to be 10 
minutes instead of 5, so it effectively cut the computing time of 
the model in half. However, a problem arose, when we tried to 
extend this technique to an ultrafine resolution model. 

The split grid technique was not amenable to using TASU (Time 
Alternating Space Uncentered) , the method developed to prevent finite 
amplitude stationary computational instabilities. This did not 
matter for the fine model because no significant checkerboard 
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pressure patterns showed up in the forecasts, but checkerboard 
patterns of about 5 mb in magnitude showed up in the ultrafine 
forecasts. A method of eliminating such spurious checkerboard 
I pattern has been developed by Shapiro (1970) and that method was 
used at GISS to eliminate the checkerboard. We used the 16th 
order version of Shapiro's filter. To 16th order it conserves 
energy and vorticity. It removes the checkerboard pattern only 
and does not otheirwise affect the calculations. 

The topography used by the ultrafine model was generated 
from the 1“ x 1* terrain heights compiled at Scripps Institution 
of Oceanography as published by W.L. Gates and A.B. Nelson (1973) . 
The heights were averaged to the GISS 2.5® by 3® grid to obtain 
GISS ultrafine topography. 

4.3 TESTING THE ULTRAFINE FORECAST MODEL (r. Atlas) 

Two forecasts were made to evaluate the forecast skill of the 
new ultrafine high-resolution model. They were carried out using 
NMC analyses produced for the DST-5 period as initial conditions. 
Comparison of the skill scores of the new ultrafine model with 
the standard GISS fine model, and NMC's own model forecasts are 
shown in Figures i and 3. It should be noted here that the NMC 
model has a certain advantage in these comparisons in that it uses 
the same topography for both the analysis and forecasts, whereas 
the GISS topography is quite different so some errors may result 
from incorrect extrapolations to sea level. 
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500 mb GEOPOTENTIAL HEIGHT STATISTICS 

AVERAGED STATISTICS FOR AUG. 18 8 23, 1975 
4 DAY FORECAST OVER U S. 

ULTRAFINE AND FINE GRID COMPARISON 


/ 

/ 

/ 

/ 

/ 



NEW MODEL 

OLD MODEL 

— NMC MODEL 





An additional test was made using the NMC analysis for 12Z 
May 10, 1976. This forecast was of special importance for the 
following reasons: on this date the forecast with the operational 

Primitive Equation (PE) model at NMC generated a physically unreal- 
istic 36-hour, 300-mb isotach prediction. The operational PE 
forecast produced a significant ageostrophic flow leading to 
gross overestimation of the wind speeds over California. This 
problem has recurred often, and a decision was made to closely 
investigate this case. The forecast was redone with a hemispheric 
model developed by Dr. N. Philips of NMC which used the same resolu- 
tion, and the problem was eliminated when a higher resolution 
embedded grid was introduced over the United States. 

The experiment was repeated at GISS to determine if improve- ■ 
ment in the forecast was due to the increase in reolution or if 
it was model- or data-dependent. 

Fine (4° by 5°) resolution and ultrafine (2.5® by 3°) reso- 
lution models were used to generate a forecast from the operational 
analysis provided to GISS by NMC. The analysis data were valid 
for 12Z May 10, 1976. Initial data in the Southern Hemisphere 
and equatorial latitudes were not reasonable and were replaced by 
summer climatological fields. Examination of the forecasts indi- 
cated the following: 


vD No signif ica^<"b cross geopotential flow occurred in the 

GISS fine orj ultrafine predxctions. Although a southerly 
extension of i>he Pacific isotach maxima does develop after 
24 hours, these isotachs do conform with the general 
contour pattern associated with a weak Pacific ridge 
generated by th <2 model , and isotachs are present in the 
verification. The results are in direct contrast to 
the NMC predictions, which had isotachs of high wind 
speed crossing geopotential contours at a large angle. 

(2) The GISS fine model {like the NMC model) was slow in 
its movement of a trough into Montana, as well as the 
movement of a weak high-pressure ridge over California; 
also it did not extend the high-pressure system at 130“ 
longitude far enough north. 

(3) The GISS fine model did not sufficiently develop the 
isotach pattern over the northwestern United States. 

(4) The ultrafine version gave a significantly better set 
of predictions : 

(a) The position of the trough in Montana is 5® 
in longitude closer tc what vtfas observed. 

(b) The position of the ridge off California is 
also displaced further east by 5°. 

(c) The isotach errors are much smaller. Differ- 
ences of 20 knots can be noted at the center 
of the Pacific isotach maxima and over the 
northwestern United States. 
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(5) 


Changes in the isotach strength at 300 mb appear to 
be related to changes in the vorticity gradient at 
that level. This may in part explain the decrease of 
isotach maxima speeds after 6 hours. 

The tentative conclusions of the Forecast Model and Development 
Group were that better data specification over the oceans and 
low-latitude regions might have improved skills, but the problem 
in question is clearly model-dependent. The forecast was 
significantly improved when higher resolution was used. 

The above findings show that the ultrafine model significantly 
improved forecast skill. Both skill score and forecasts of 
synoptic systems are improved. Therefore, efforts of the Forecast 
Model and Development Group were focused on a data assimilation 
and forecast experiment with the ultrafine model. 

4.4 IMPLEMENTATION OF THE ULTRAFINE ASSIMILATION CYCLE WITH 
DST-6 DATA 

4 . 4.1 Introduction 

In the previous section it was shown that increasing the 
horizontal resolution of the model gave better forecasts. The 
next question to be answered was: Could using the ultratine model 

for an assimilation cycle also improve the initial state? The 
importance of the initial state has been stressed in a paper by 
Baurahefner (1977) . Baumhefner compared forecasts from an initial 
state prepared by the Working Group on Numerical Experimentation 
(WGNE) with forecasts made from an initial state prepared by NMC. 
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He found that the one-day forecasts made with the NMC initial 
states were 25 percent better than the forecasts made with the 
WGNE data. Since both groups used the same data in their analyses, 
this difference must be due to either differences in the first 
guess field (i.e., the 12-hour forecasts from the previous 
synoptic time) or their method of inserting data. In either 
case, it is evident that the method of arriving at an initial 
state is critical. 

^.^.2 Assimilation and Forecast Experiments Used to Test the 
Ultrafine Model 

There are two aspects of model skill that were tested using 
DST-6 data: 

1. Was the forecast model improved by using ultrafine 
resolution? 

2. Were the initial conditions improved by using the ultrafine 
model? 

To answer these two questions three assimilation and forecast 
cycles were carried out: 

1. A fine control experiment that consisted of a fine NO SAT 
assimilation cycle was carried out from January 29 to Feb- 
ruary 12, 1976. This experiment is described in Section 3.2. 

It used the direct insertion method (DIM) Section 3.2.1 of in- 
serting observed data. Eleven forecasts were made from initial 
conditions taken from the assimilation run. The forecasts 
were for February 1, 3, 5, 7, 9, 11, 13, 15, 17, 19 and 21. 
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2. An ultrafine experiment that tested the full effects of 
using the high-resolution for both an assimilation run 
and for eleven forecasts for February 1, 3, to 21. This 
experiment differed in a few subtle ways from Experiment 1. 

First of all, the Successive Correction Method (SCM, see 
Section 3.2.4) was used to insert observed data during the 

assimilation run, since the paucity of observed data made 
it impossible to use the DIM method for the ultrafine 
model. This, however, should have no affect on our con- 
clusions, since, as shown in Section 3.2.4 use of the SCM 
method has little affect on the fine model assimilation 
cycle. The other way that this experiment differed from 
the control was that the actual observed snow from the 
first week of February was used to estimate albedos, 
instead of using climatological albedos. This, however, 
had little affect on model predictions except for those of 
ground temperature. A fine control run using the SCM method 
and having February observed albedos is now beina run, so 
that a more perfect control run will be available. 

3. A set of eleven fine forecasts that used the ultrafine 
assimilation for initial conditions. This experiment 
tested how much of the improvement in the second experi- 
ment was from use of a better forecast model and how much 
was due to use of a better assimilation model. 
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4.5 PROBLEMS OF STATISTICAL EVALUATIOM 

A standard measure for evaluating the forecast skill of 
an assimilation experiment is to calculate the 12, 24, 36, 48, 

60, and 72 hour forecast BIAS errors and skills for each forecast 
made using the assimilation for an initial state. The scores 
for all the forecasts can then be averaged together to give 
average skill scores and RMS errors for each forecast interval. 

A problem arises in computing RMS and SI scores. There is 
an NMC analysis, a fine assimilation analysis, and an ultrafine 
assimilation analysis. Which analysis should be considered as 
the "truth?" It turns out that it makes a big difference. For 
example, Figure 1 shows two sets of SI scores and RMS errors for 
500-mb heights over North America. The upper set of curves 
(showing lower forecast skill) is the average of 11 ultrafine 
^ The lower scores (higher forecast skill) were obtained 
by comparing the utlrafina forecasts with the ultrafine assimxla- 
tion. Figure 5 shows SI scores and RMS errors calculated by com- 
paring the fine forecasts (Experiment 3) with the NMC analysis 
(upper curve worse skill) and the fine assimilation (lower curve 
better skill) . This would seem to indicate that a forecast model 
would have an advantage in a comparison with another forecast 
model if an analysis generated from that particular model is used 
as the comparison. For the purpose of an impartial comparison of 
two models they should be compared with an analysis generated 
from an independent source. 
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4.6 STATISTICAL EVALUATION OF THE ULTRAFINE flOBEL AND ASSimLATION 
CYCLE 

To make an impartial comparison of the three experiments 
described in Section 4.4.2, all three sets of forecasts were com- 
pared to the NMC DST-6 analyses interpolated to the GISS grids. 

The ultrafine model was compared on an ultrafine grid, and the 
fine model on a fine grid. Figure 6 shows RMS errors and SI skill 
scores over the United States and Europe for 500 -mb heights and 
sea-level pressures. The results shown were obtained by averaging 
together the scores for the eleven forecasts made for each experiment 
Over Europe the ultrafine model does not show significant increase 
in forecast skill over the fine model; however, the increase in 
skill over North America is quite significant. It is not know 
why the forecast skill improvement is better over North America 
than over Europe. 

The size of the improvement in skill score using the ultrafine 
model for forecasts and assimilation is so great that the 60-hour 
forecasts with the ultrafine model have as good a skill score as 
the 48-hour forecasts using the fine model. This equals all the 
improvements in the skill score made with NMC's forecast models 
during the 15 years from 1962 to 1976. The increase in skill shown 
here is almost twice those shown in Tables 1 and 2 for the LFM 
model. This may be due to two factors; 

1. The ultrafine model is global so it does not have to 
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contend with any errors that are induced by having a 
nested mesh. 

2 . In Experiment 2 the ultraf ine model was used to generate 
both the initial conditions and forecast. The LPM uses 
initial conditions that were generated by the same model 
that generated the PE initial conditions. 

The second hypothesis is supported by the results from Experiment 3. 

The RMS and SI skill scores obtained by doing fine forecasts, but 
using initial conditions generated by the ultrafine model (see 
Figure 6) show significantly better skill over the United States 
than the fine forecasts made from initial conditions generated 
by the fine model (Experiment 1) . 

If the improvement in skill score for the 60-hour forecast 
represents an equivalent increase in forecast skill, then the 60- 
hour forecast for the ultrafine would be equal in skill to the fine 
48-hour forecast skill. This is critically important because it 
is agreed that the 48-hour operational forecast shows some useful 
skill and that there is little if any skill in the 60-hour forecast 
and beyond. Extending the useful forecasting range beyond 48 hours 
is particularly crucial for satellite applications. The data from 
unpopulated regions where the satellite data is most useful often takes 
48 hours or longer to influence populated regions, so clearly a 
model that can forecast for 48 hours and longer is critical to 
satellite applications. 
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4.7 SYNOPTIC EVALUATION OF ULTRAFINE FORECASTS (R. Atlas) 

As a further evaluation of the ultrafine model, ultrafine 
forecasts of sea- level pressure and 500-mb heights have been sub- 
jectively compared to fine forecasts and the corresponding analyses. 
This comparison has shown that for sea-level pressure prognoses, 
significant improvements in the predicted displacement and intensi- 
fication of individual pressure systems do occur. Along with these 
beneficial impacts, smaller negative impacts are also generated. 

These negative impacts sometimes take the form of small spurious 
pressure systems and may be the result of a certain degree of noise 
in the ultrafine version. Overall, however, the ultrafine model 
produces a significantly better and more useful sea-level pressure 
prognosis than does the fine. At 500-mb, the impact of the ultrafine 
model appears smaller . On the average , a small improvement in the 
prognostic flow patterns can be noted. However, at times the impact 
is negligible or even slightly negative. 

One case study is presented below to illustrate the impact of 
the ultrafine modal. This case is typical of the sample studied 
in that it depicts both positive and negative impacts in the prog- 
noses. The results were compared to the NMC analyses interpolated to 
the GISS ultrafine grid rather than to the NMC fine analyses, because 
comparison of both analyses with NMC's hand-drawn analyses of surface 
stations showed this procedure to be more accurate. 
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Case I; Forecast From Feb. 1, GOZ ^ 

a) Sea Level Pressure 

Figure 7a presents the initial conditions for this forecast; 
^i^ures 8a/ 9a/ and 10a are the 24/ 48/ and 72 hour fine forecasts; 
Figures 8b/ 9b/ and 10b are the 24/ 48/ and 72 hour ultrafine fore- 
casts; the corresponding analyses are presented in Ig'igures 8c / 9c / 
and 10c. 

In this case/ cyclogenesis occurs near the Gulf coast and this 
new cyclone merges with a low that had been moving toward the east 
coast from the west. This results in a large intfensifying low over 
the eastern U.S. at the end of 24 hours. 

The major differences between the fine and ultrafine 24-hour 
forecasts are the intensity of this eastern U.S. low/ the position 
of the Canadian high approaching the Great Lakes, and the develop- 
ment of spurious pressure systems in each forecast. The fine model 
has correctly predicted the displacement of a low to the east of 
the Great Lakes but has failed to develop the new low or the merged 
system,. This results in a much weaker cyclonic circulation than is 
observed. In addition, it is slow in its movement of a Canadian 
high towards the Great Lakes and develops a small high over Mexico 
and a weak low in Canadian Rockies which do not appear in the analysis. 

The ultrafine model has correctly predicted the development of 
the large intensifying low over the eastern U.S. and has displaced 
a Canadian high much closer to the Great Lakes, in better agreement 
with reality. It did not develop the spurious high over Mexico, but 
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iiicorreofely did generate two low pressure centers on the lee side 
of the Rockies. Both models are similar in their failure to predict 
a eyclonic circulation entering southwest Canada, and in their posi- 
tioning of a high pressure system over the northwestern U.S., although 
minor differences in these features do exist. 


By 48 hours, large errors in both the fine and ultrafine pre- 
dictions are evident. However, ronjor differences between the two 
forecasts are apparent. Neither model has correctly predicted the in- 
tensity or position of the intense low now over southeast Canada. 


But the ultrafvtne prediction of this system is significantly better. 
The ultrafine model has forecast the central pressure of this low 
to be 12 mb deeper and the position of the low's center is also in 


bettor agreement with reality. This has resulted in a more accurate 
prediction of the pressure gradient over the northeastern U.S., oven 


though the oriontation of the isobars for both the fine and ultrafine 
predictions is in error in this region. 


The 

ter 

pic 


Over the remainder of the g.s. differences are more subtle, 
ultrafine prediction depicts the isobaric pattern, slightly bet- 
over southwestern Canada and the western U.S., but incorrectly de- 
ts a more intense low in the central U.S. 


At 72 hours, the improvement of the ultrafine prediction is 
evident even though significant errors are also present. The fine 
model predicts a closed high to be centered over the middlo-Atlantic 
states, and a strong cyclonic circulation to be dominating the central 
and western U.S. It fails to predict the intense high pressure ridge 
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•-hich extends from southwest Canada to the central plains. In oontrast, 
the ultrafine model moves a high pressure center off the east coast 
Of the U.S. and correctly indicates a high pressure ridge extending 
to the central plains. In addition, its representation of the complex 
low in the central u.s. appears closer to the observed situation. 

(b) 500 Mb Heights 

Figure 7b presents the initial condition for this forecast; 

» 12a, and 13a are the 24 4 r ~ j, j- . 

ctre cne , 48, and 72 hour fine forecasts; 

Figures 11 b, 12b, and 13b are the 24 48 79 k 

uae 48, and 72 hour ultrafine fore- 
casts; the corresponding analyses are presented in Figures He, I2a 
and 13c. 


In this case, a broad trough extending from the midwestern U.S. 
to the western Gulf of Mexico, intensifies as its southern end moves 
rapidly eastward during the first 24-hour period. At the same time 

a very slight flattening of the ridge over western North America 
occurs . 

The 24- hour fine forecast correctly predicts the slight flat- 
tening of the ridge and the intensification of the trough , but 
has failed to move the southern end of the trough far enough east. 

As a result, the change in orientation of this trough is not pre- 
dicted. 

The 21- hour ultrafine forecast indicates the intensification 
of the trough correctly and moves the trough almost 5° of longitude 
further east (at 30 °N) in better agreement with reality. However, 


) 


the uXtrafine's movement of the southern end of the trough is aXso 
slow, and thus the ultrafin has also failed to predict the change 
in orientation of the trough which has occurred. In addition, the 
ultrafine forecast depicts an excessive flattening of the western 
ridge. 

({ 

By 48 hours, both the trough and the ridoe have flattened con- 
srderably . V^esterly flow dominates the eastern O.S. while northwest 
flow predominates over the remainder of the U.S. Both the fine and 
ultrafine 4 8 -hour forecasts correctly indicate that northwest flow 
will dominate most of the B.S., but neither depicts the slight anti- 
cyclonic curvature of the contours over the Rockies, or the devel- 
opment of a closed low southeast of Hudson Bay. The major difference 
between the two forecasts is the position and structure of the trough 
which extends southward from Canada into the II. S. 'Ihe ultrafine 
prediction depicts a sharper trough to be located further east and 
to have a more north- south orientation than that predicted by the 
fine model. One additional difference may be noted in the orienta- 
tion of the 5700 -m contour of the southwestern O.S. and northern 
Mexico. Here the fine model has incorrectly depicted a more cyclonic 
curvature of this contour. 

By 72 hours, a radical re-orientation of the pattern has oc- 
curred. A new trough with an east-northeast to west- southwest 
orientation now extends from extreme south central Canada into the 
northv'^estern u.S. and west-to-east flow now predominates over the rest 
of the U.S. Both the fine and ultrafine models have failed to predict 
each of tl\ese features and it appears that the only major differences 
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between the two forecasts are the positioning of a spurious short 
wave ridge in southeast Canada and the extent of troughing of the 
contours over the central United States. 

^.8 CONCLUSIONS 

1, Statistical analyses for 11 cases relative to the NMC analysis 
and synoptic evaluations show that assimilation experiments performed 
with the ultrafine model produce better forecasts than the experiments 
done with the fine model at all forecast intervals. It is necessary to 
use the ultrafine model for both the assimilation and the forecasts. 


2. Use of the ultrafine model yields skill scores and rms 
comparisons with NMC analyses for 60-hour forecasts that are as 
good as the fine 48-hour forecasts. This is important for assessing 
the impact of satellite data, since it takes 48 hours for satellite 
data to make large impacts for forecasts over populated regions. 

3 . Only a 5-fold or larger increase in computing power can make 
use of the ultrafine model possible on a routine basis. 

4. One must be very careful in evaluating statistical scores. 

If one model is used for both generating a forecast and the analysis 
to which the forecast is compared, it will have a big advantage over 
another model which is compared to the same analysis. Until this 
ambiguity is resolved it will be difficult to state quantitatively 
just how much the ultrafine model has improved over the fine model, 
but from both our synoptic studies and those of NMC it is obvious 
that use of higher resolution does improve forecast skill. So far 
it is the only known method of improving model forecasts. 
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DEFINITION OF THE MODEL USED FOR THE GCM EXPERIMENTS 

The model used in this study is the same model as described 
in Somerville et al. (1974) with three exceptions; 

1. The numerical differencing near the poles was modified 
so a nearly equal area mesh was used near the poles. This split- 
grid technique has been described by Halem and Russell (1973) . 

The use of the split-grid technique allowed the model's time step 
to be 10 minutes instead of 5, so it affectively cut the computing 
time of the model in half (see Section 4.2). 

2. The mountains over Greenland have only half the height 
prescribed in the topography given in Somerville et al. This was 
done because the split-grid model could not handle the flow over 
the steep mountains in Greenland. These mountains, which are near 
the pole, seemed twice as steep for the split-grid model as for 
the regular grid model since it only had half as many grid points 
at these latitudes. 

3. A more realistic distribution of albedo was used. Instead 
of using an arbitrary latitude for the extent of snow to determine 
albedo and letting all other land have 14% albedo, climatologically 
realistic albedos were specified for all land areas. The global 
surface albedos were specified by using Posey and Clapp (1964) as 
compiled by Shutz and Gates (1972a and b) . 
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CHAPTER V 


5. EVALUATION AND VERIFICATION TESTS 

(R. Atlas, Scientist; D. Sakai, Manager) 


5.1 INTRODUCTION 


The Evaluation and Verification Group (EVG) was organised to 
evaluate the forecasting impact of satellite data in support of the 
DST impact Test Project. Traditional statistical measures of fore- 
cast accuracy have been the general tool used for this purpose. 
However, in recent years the value of Interpreting these statisti- 
cal measures in terms of actual improvements to weather prediction 
has been questioned by the meteorological community. 

This report attempts to evaluate the Impact of satellite 
data insertions in the context of a real-time forecasting operation, 
specifically to determine: (1) if the inclusion ot satellite data 
results in significantly different analyses and prognostic flow 
patterns, (2) if the impact of satellite data is large enough to 
result in different actual weather forecasts, as might be prepared 
by a local weather forecaster, and (3) if this impact is beneficial. 

For this purpose a prognostic plot package, similar to that 
distributed by NMC for use by local weather forecasters, has been 
developed and tested. Based on the subjective forecasting techniques 
which were applied to this plot package, a computerized forecasting 
model (CFM) was developed, which is capable of simulating the subject! 
forecasting process under very restrictive conditions. As a result 
of these tools, the evaluation of the forecasting impact of the 
satellite data can thus be expressed in terms of statistical scores. 
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differences in prognostic charts, and actual differences in local 
weather forecasts. 

The major findings of the EVG for the winter DST-6 Impact 
Test are: 

(1) the impact of satellite sounding data over data-sparse 
regions is large enough to influence actual local weather fore- 
casts, 

(2) significant differences in prognostic flow patterns 
occur as a result of the inclusion of satellite data, 

(3) significant impacts on prognostic vorticity and vor- 
ticity advection fields often occur, even when no impact is dis- 
cerhable in the contour field, 

(4) the inclusion of satellite soundings does not result in 
a systematic smoothing out of potential temperature gradients, 

(5) for the limited number of DST-6 cases stuaied, the 
evaluation techniques employed indicate that the impact is in 

general modest and favorable, and in several cases, large beneficial 
impacts occur. 

In the following sections the results evaluating the impact 
of satellite sounding data on meteorological analyses and forecasts 
will be presented. Section 5.2 contains a review of the subjective 
evaluation of the DST-5 data set and the development of evaluation 
procedures. In Section 5.3, the nature and magnitude of the impact 
of satellite soundings on the initial states is presented. In 
Section 5.4, a statistical and synoptic evaluation of the impact of 
satellite soundings on prognostic flow fields is presented. In Section 
5.5 the impact on actual local weather forecasts is described. Finally, 
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Section 5.6 contains our conclusions and recommendations for future 
research. 

5.2 BACKGROUND 

5.2.1 Preliminary Subjective Evaluation 

Prior to beginning the evaluation of the DST-6 data set, a 
preliminary subjective forecast experiment and a subjective 
evaluation of prognostic charts were carried out with DST-5 data. 

The preliminary subjective forecast experiment was conducted in the 
following manner; a set of SAT and NO SAT prognostic packages 
(consisting of sea-level pressure, 1000- to 50 0-mb thickness; 850-mb, 
700-mb, and 500— mb geopotential heights; 850-mb temperatures and 
dewpoint depression; 500— mb absolute vorticity and vertical velo— 
^ity; and 300-mb isotachs) were delivered to two human forecasters, 
without the corresponding analyses for verification. These fore- 
casters would then note all of the major differences between SAT 

and NO SAT forecasts by con^jaring the maps for the United States 
and noting the meteorological variables at four different cities 
(New York, Chicago, Atlanta, and San Francisco) at 12-hour in- 
tervals for 84 hours. Finally, an actual weather forecast was 
issued for each of these cities at these times. Each forecast was 
based completely on the SAT or NO SAT prognostic charts (progs) 
without human modification. 

TWO of the 14 DST-5 forecasts, which were studied subjective- 
ly are presented below. Both of these forecasts were cases of 
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large positive statistical impact, but the extent to which the 
flow patterns and actual weather of the United States were affected 
was not known. 

In the first forecast, from OOZ August 26 initial conditions, 
no significant impact on the flow patterns Was initially obvious, 
and the actual weather forecasts for New York, Chicago, Atlanta, 
and San Francisco were the same for SAT and NO SAT predictions 
throughout the forecast period. However, initially small differences 
in the flow pattern increased in amplitude with time so that by 
72 hours significant differences in the absolute vorticity pattern 
were evident. By 84 hours the vorticity differences were evident, 
even over the United States and Canada, and it is obvious that 
differences in weather would be expected from the SAT and NO SAT 
predictions for the affected regions. 

Figures 1 and 2 illustrate these differences for the 84-hour 
forecast. On the maps, the solid lines represent isopleths of 
absolute vorticity, while the dashed lines represent the 500-mb 
contours for the same time. Areas in which the 500-mb contours 
are crossing vorticity isopleths from high to low values represent 
positive vorticity advection (PVA) , and areas where the 500-mb 
contours are crossing vorticity isopleths from low to high values 
represent negative vorticity advection (NVA) . These areas are 
important because PVA is normally associated with low-level con- 
vergence, upper-level divergence, rising motion, cloudiness, and 
precipitation, while NVA is normally associated with upper-level 
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convergence, low-level divergence, sinking, and clearing conditions. 
Note that the 500-mb flow as represented by the dashed lines is not 
significantly different for the SAT and NO SAT cases, while the 
vorticity patterns over the western United States, the extreme 
northeastern United States, and southeastern Canada are significant- 
ly different. In particular, note that the vorticity maximums in 
these two areas are displaced further east and are more intense 
for the SAT case. This results in strong PVA for the southwestern 
United States coast and extreme northeastern United States, strong 
NVA over the Pacific from 130“W to 125“W, and in portions of New 
England on the SAT forecast, while no significant vorticity advec- 
tion is evident in the NO SAT forecast. 

The second forecast, from OOZ August 31 initial conditions, 
produced a slightly different outcome. Once again the differences 
in flow patterns were initially small. However, in this case the 
small differences in the positions of pressure systems, atmospheric 
flow, and trends of variables for a particular area were evident 
over the United States and actually resulted in different subjective 
forecasts being issued. Table 1 shows the trend of vorticity at 
the four cities. Obvious differences may be noted for New York 
and San Francisco. 
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Table 1. Trend of Vorticity at Selected Cities 


These forecasts were generated from OOZ August 31 initial conditions. 
Values indicate the absolute vorticity at each city for the SAT 
and NO SAT forecasts. 


DAY 


0 


1 

ih 

2 

2h 

3 

3h 

New York 

SAT 

10 

9 

9.5 

9.5 

9.5 

9 

9 

9 


NO SAT 

10 

9 

9 

9 

9 

8 

7,5 

6.5 

Chicago 

SAT 

12 

11 

11 

missing 

8.5 

5.5 

4.5 

5 


NO SAT 

12 

12 

11 

10 

7.5 

5 

5 

5 

Atlanta 

SAT 

8 

7 

8 

7 

7.5 

7.8 

8 

7.5 


NO SAT 

8 

8 

8 

8 

8.5 

8.5 

8.5 

8.5 

San Francisco 

SAT 

7 

6.5 

7.5 

8.5 

9 

9 

9.5 

9.5 


NO SAT 

8 

7 

7 

6 

8 

8.5 

8 

8 


Differences in meteorological patterns may be noted after just 
48 hours in this case. Figures 3 to 8 depict the 48-hour progs of 
sea-level pressure, 500-mb geopotential heights for the SAT and NO 
SAT cases. Two differences can be seen on the sea-level pressure 
map. There is a small high southeast of New York on the SAT progs 
which is missing on the NO SAT. This causes a change in the wind 
direction at New York City. Also the high-pressure ridge on the 
west coast of the United States and a small high center in the 
northern plains are not as well developed on the SAT as on the NO 
SAT progs. 
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At 500 mb the orientation and development of the trough xn 
the northwestern United States and the adjacent ridge differ 
slightly between the two progs. This difference is more evident 
in the vorticity field, where a stronger vorticity minimum is 
evident on the SAT forecast. 

These two cases demonstrated that the impact of satellite data 
can be large enough to influence subjective weather forecasts and 
prognostic flow patterns, as well as the importance of evaluating 
impact in terms of vorticity advection. 

5 . 2.2 The Computerized Forecasting Model 

The computerized forecasting model (CFM) was designed to simulate 
the human forecaster's interpretation of a set of prognostic charts 
under the restrictive condition that no modification of the prog- 
notic flow patterns (as forecast by the GISS model) can take place. 

It has two main advantages over the human forecaster approach; 

(1) by use of the CFM, forecasts can be generated for any number of 
cities in a very short amount of time, and (2) the procedures that 
are applied to each set of prognostic charts will be uniform. 

The major quantities forecast by the CFM are precipitation 
occurence, type of precipitation, and 24-hour surface temperature 
change. Obviously the CFM cannot perform pattern recognition in 
the same manner as a human forecaster. But it can take account of 
most patterns in terms of the computed advection of certain qvian- 

tities . 
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Figure 3. 48—Hour NO SAT Prediction of Sca—Levol Pressure. 
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Figure 7. 48-nout no SAT PrecUetiou of 500-inb Absolute Vorticity. 



Figure 8. 48-Mour SAT I'rcHctlon of 500-st> Absolute VortltiUy. 


The first step of the CFM precipitation scheme is to compute 
forecast parameters for every city at which the CFM 
is to be applxed. These forecast parameters are listed in Table 
2, and it ca^} readily be seen that this list includes most of the 
basic tools that are used by operational forecasters to predict 
areas of large-scale precipitation. 

The next step is to test the dewpoint depression to determine 
if there is sufficient moisture for precipitation. If this criteria 
IS met, then we next test the vorticity advection field. As men- 
tioned earlier, positive vorticity advection (PVA) is a sti;ong 
indicator of upward vertical motion , whereas negative vorticity 
advection (NVA) is a strong indicator of downward vertical motion. 
Generally, if pva is coupled with sufficient moisture, precipitation 
will occur. However, the effects of temperature advection must also be 
considered because strong cold advection can negate the effects of 
PVA, whereas warm advection will enhance it. The manner in which 

the CFM combines these quantities is illustrated in Figures 9 
through 11 . 

Once the above precipitation calculation is completed, two 
additional tests for precipitation are performed. These include 
a test for cold frontal precipitation (Figure 12) and a gross 
check for the potential for showers (Figure 13). Finally, a test 
for the type of precipitation is made as illustrated in Figure 14. > 

A sample of the CFM's output is presented in Figure 15. 
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Table 2. Forecast Parameters 


VORTICITY ADVECTION 

(VA) 

TEMPERATURE ADVECTION 

(TA) 

THICKNESS ADVECTION 

(TKA) 

MOISTURE ADVECTION 

(MA) 

DEWPOINT DEPRESSION 

(DD) 

WIND DIRECTION 

(WD) 

VERTICAL WIND SHEAR 

(VWS) 

850-MB TEMPERATURE 

(850T) 
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Figure 13 
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The CFM has been evaluated from two standpoints: (1) its 

accuracy when applied to a perfect prognostic chart (an analysis) , 
and (2) its agreement with human forecasters. It has been found 
that for February 1976, the CFM was 93 percent accurate in cor- 
rectly interpreting whether or not precipitation would occur, 
and 76 percent accurate in verifying a positive forecast of pre- 
cipitation, and 76 percent accurate in accounting for precipitation 
which was actually observed. Its agreement with human forecasts 
was 94 percent for this period of time. 

5.3 IMPACT OF SATELLITE DATA ON ANALYSES 

If satellite soundings are to lead to improved or even dis- 
tinct forecasts, then the origin of the forecast differences in the 
initial state conditions should at lease be discernable. The 
initial state differences obtained in the impact test conducted for 
the period January 29 to February 21, 1976 are presented for 
all the sounding data which have thus far been processed. The 
method used to assimilate the sounding data was based on a four- 
dimensional optimal statistical interpolation procedure applied to 
both the NOAA 4 and Nimbus 6 satellites simulataneously . 

5.3.1 Initial State Differences (m. Haiem) 

Figures 16a and 16b show the 500-mb geopotential height 
difference fields for two analysis cycles, one including all the 
soundings from both satellites (called SAT) and the other with- 
holding all satellite soundings (called NO SAT) . The charts 
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Fig. 16a 













indicate the daily variations occurring in the initial states of 
each cycle at the beginning of each forecast period. The magnitudes 
of the differences vary as a result of variations in coverage, data 
quality, instrument difficulties encountered in processing the 
sounding data or just natural atmospheric variability. It is clear 
from the charts, that day after day, differences of the order of 
30 - 120 meters are produced in the data-sparse regions of both the 
Pacific and Atlantic Oceans. Geopotential height differences of 
this magnitude correspond to 1.5° to 5°C temperature differences 
in the 1000- to 500-mb thickness. The variations are of both 
signs, although there seems to be a systematic tendency for warmer 
temperatures in the SAT system over most of this assimilation 
test. When the satellite tracks were superimposed, it was noticed that 
the largest differences occurred mainly in the data-sparse areas 
along the tracks where sounding data have recently been inserted. It 
was also observed that where the initial state differences are 
small (i.e. , no differences of large areal extent at midlatitudes 

in the Pacific greater that 60 meters) the forecast impact in 
terms of statistical skill scores and rms scores is generally 
smaller as one might expect. 

Upon closer examination of factors that might lead to weaker 
or stronger initial skate differences, it was discovered that a 
lack of data coverage is sometimes responsible for certain cases 
where weak impacts occurred. For example, February 13 showed a 
weak impact and in fact 3 hours of data or nearly two orbits of 
sounding retrievals that would have passed over the Gulf of Alaska 
just prior to synoptic times were missing. An examination of all 
missing data and their positions revealed that several critical 
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gaps in coverage had a significant influence on the outcome of 
this test. In the case of February 13, when data were recovered 
the magnitude of the initial state impact increased in some 
legions by as much as 60 meters. As a result, gaps in the data 
were complete recovered and the DSI data were reprocessed to pro- 
vide as complete data set as possible for conducting the impact test. 

An additional factor influencing the magnitude of initial 
state differences resulting from the insertion of sounding data 
is the dependence of the analysis cycle on the method of assimila- 
tion. Studies show that the "optimal statistical weighting" 
approach suggested by N. Phillips, spreads the information over 
larger areas than other methods tested (e.g., local successive 
correction techniques) and through statistical corrections leads 
to better and more consistent impact results. The particular 
approach used by GISS takes advantage of the quantity of data 
available at each time interval using the statistical weights to 
improve the quality of the data. 

From the nature of the initial state differences above, one 
cannot say, a priori, whether the satellite system would produce 
beneficial forecasts, but only that the magnitude of these 
(differences are sufficiently large so that one would expect them 
to produce a significant number of distinct forecasts. 
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5 . 3.2 IsENTROPic Cross Section Analyses 

An evaluation of isentropic cross sections produced with and 
without the inclusion of satellite soundings was conducted in order 
to determine if systematic differences between the two analyses 
exist. In previous reports concerning the evaluation of satellite 
data at NMC, Tracton had stated; "the thermal structure of weather 
systems is systematically less in the analyses which incorporate 
satellite soundings than in those from which satellite data is 
excluded. " In addition he presented an example of isentropic cross 
sections produced with and without satellite soundings to illus- 
trate the systematic smoothing of intense gradients of potential 
temperature, which resulted from the inclusion of satellite data, 
at NMC. 


The evaluation of isentropic cross section at GISS consisted 
of a subjective comparison of cross sections produced with and 
without satellite soundings, and an objective comparison of moderate 
to intense horizontal potential temperature gradients between the 
two fields. Isentropic cross sections were constructed for the 
GISS (4°lat by 5°long) grid, along specific longitudes in the data 
sparse regions of the North Pacific, and also over the United States 
and Canada where radiosonde data is available. It should be noted 
that although the use of the GISS grid is adequate for determining 
the effect of satellite data on the initial states, it does not allow 
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for a direct comparison with the NMC cross sections analysis which 
were constructed from the raw data itself on a finer resolution. 


Isentropic cross sections were evaluated for each of the 
eleven initial states which were described in Section 5.3.1. The 
subjectxve comparison of cross sections revealed that only very 
minor differences between the SAT and NO SAT analyses existed over 
the United States while larger and more significant differences 
were evident over the North Pacific. Several cases of weaker and 
stronger gradients of potential temperature in the SAT analysis 
occurred, and no systematic smoothing out of these gradients was 
observed. Figures i?a and 17b depict typical NO SAT and SAT cross 
sections over the United States. It is obvious that no significant 


differences between the two cross sections exist and that the inclu- 
sion of satellite data has not resulted in a degradation of the 
analysis. Figures 18a and 18b depict an example of NO SAT and SAT 
cross sections over the North Pacific. In this case, significant 
differences between the two cross sections are observed. For 
example, a more intense gradient of potential temperature in the 
low to middle troposphere and a more detailed thermal structure 
in the upper troposphere have resulted from the inclusion of satellite 

soundings. Although the impacts depicted in Figure 18 occurred near 
the 200mb and 600mb levels (which correspond to peaks of weighting 
functions for the microwave sounder) , no tendency for Impacts to occur 
at these levels was observed. The satellite soundings thus appear to 

be capable of resolving thermal structures over the ocean which are 
not otherwise observable. 

The objective evaluation of isentropic cross sections consisted 
Of a comparison of all moderate to Intense horizontal gradients 
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Figure 18. NO SAT (a) and SAT (b) Isentropic Cross Sections, Along 
Longitude 170 for OOZ February le. 






of potential temperature at all mandatory isobaric surfaces. 

Wherever a horizontal gradient of greater than 8°K between 2 
gridpoints occurred in either the SAT or NO SAT systems, the gradients 
of each system were compared to determine if the SAT gradient 
was weaker, more intense, or approximately the same as the NOSAT 
gradient. Over the United States, 119 cases were compared. Of 
these the SAT gradients were weaker 27 percent of the time, more 
intense 8 percent of the time, and unchanged 65 percent of the 
time. Over the North Pacific 406 cases were compared. Of these 
the SAT gradients were weaker 40 percent of the time, more 
intense 24 percent of the time, and unchanged 36 percent of the 
time. 

An objective comparison of potential temperature gradients 
along specific latitudes has also been conducted. Over the 
United States 174 cases of moderate to intense horizontal gradients 
of potential temperature were compared. Of these the SAT gradients 
were weaker 18% of the time, more intense 20% of the time, and un- 
changed 62% of the time. Over the North Pacific 482 cases were 
compared. Of these the SAT gradients were weaker 40% of the time, 
more intense 29% of the time and unchanged 31% of the time. In 
general a tendency toward warmer temperatures was observed in the 
SAT analysis but no systematic smoothing of potential temperature 
gradients was evident. 
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5.3.3 The Energy Spectrum of the Satellite and No-Satellite Analyses 

(W. J. Quirk) 

The energetics of the satellite and no satellite analyses 
produced by NMC have been analyzed by Steven Tracton of NMC and 
discussed in several widely circulated memos. Tracton has evaluated 
the eddy available potential energy of the analyses. The eddy 
available potential energy depends on two quantities, the departure 
of the temperatures at a given latitude [T~T] and the departure 
of the vertical temperature gradient from an isentropic profile 
(See Peixoto, Jose P. and Abraham H. Oort, 1974. The annual distribu- 
tion of atmospheric energy on a planetary scale, J. Geophys. R es., 79, 
2149. ) 

Figure 1 is a graph produced by Tracton showing the day to 
day variation in eddy available potential energy above 30° latitude 
for a few days during DST 5. Tracton has pointed out that the 
satellite system has 10% less energy than the no satellite system. 

He has stated that this difference means that the satellite system 
must be making a systematic error that underestimates eddy energy 
which the no-satellite system calculates correctly. In fact only 
a very detailed study could determine whether it is the satellite 
oi‘ no satellite system which is correct. 

To further verify and study Tracton *s findings we have calculated 
the eddy available potential energy (north of the equator) for both 
the GISS SAT and NO SAT DIM assimilation, and for the NMC satellite 
analyses interpolated to the GISS grid (See Figure II) . Note that our 
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calculation of the NMC eddy energy is lower than Tracton's calcu- 
lation shown in Figure I. This is because almost all of the eddy 
energy is north of 20°N, but it was averaged over the whole hemi- 
sphere whereas Tracton averaged only above 20°N. Figure III shows 
the same quantities fOr DST 5, but for the Southern Hemisphere. 

Figures IV and V show the Northern and Southern Hemisphere quantities 
for DST 5 and 6. All 4 cases show that the satelitte case has 10%- 
15% less energy than the no satellite case. However they also show 
that the GISS satellite analysis has 25%-50% more energy than the 
NMC satellite analysis. 

Table A shows a spectral analysis of the Northern Hemisphere 

Available Potential Energy during DST 5. The first row gives available 

potential energy for wave numbers N for N=0 through 15 and the total 
30 

eddy energy (S ) for the GISS NO SAT case. The second line gives 
the same quantities for the SAT case. The difference between the 
NO SAT and SAT cases are given on the next line. The fourth line 
gives a running sum of the sum from 1 to N of the difference between 
SAT and NO SAT. 

The running sums show that virtually all the differences 
between wave SAT and NO- SAT are in wave numbers 1, 2, and 3. These 
differences were to have been expected from examination of SAT and 
NO SAT height fields difference maps. The difference between SAT and 
NO SAT height fields is' primarily in definition of the Aleutian and 
North Pacific regions, areas where there is little conventional data. 
Comparisons between the GISS and NMC SAT cases show the NMC analysis 
is relatively low in eddy energy compared to GISS analysis at all 
wave numbers. Examination of plots (see Figure VI) of both analyses, 
reveals that the NMC analysis scheme has systematically smoother fields 
than the GISS analysis. Comparison of both of these maps with hand 
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Table A. Eddy Available Potential Energy 


Wave Number N 1 0 ^ - - - , ■ 

GISS HO SAT 115747 1.28 0.60 0.42 0 . 25| 0 . 23] 0 . 34] 0 . 2o| 0 . 17 | 0. 10 1 0 . 07 | 0 . 06 1 0 . 05 1 0. 05 | 0 . 05 | 0 . 04 | 4 . 34 


11 

12 

13 

14 

15 

0.06 

0.05 

0.05 

0.05 

0.04 


GISS SAT 


NO SAT 


Z (NO SAT-SAT) 


1.09 

0.54 

0.36 

0.24 

0.19 

0.06 

0.06 

0.01 

0.19 

0.25 

0.31 

0.32 


0.05 

0.05 

0.05 

0.04 

0.00 

0.00 

0.00 

0.00 

j0.31 

0.31 

0.31 ' 

0..31 


NMC SAT 


Z (GISS SAT - 
‘ NMC SAT) 


0.02 2.72 


0.73 0.41 0.30 0.20 0.18 0.28 0.16 0.12 0.07 0.04 0.04 0.03 0.02 

0.23 lo . 36 0.13 0.06 0.04 0.05 0.06 0.06 0.04 0.03 0.03 0.02 0.02 0.03 0.03 0 ^^^ 2 _| l .27 

0.36 0.49 0.55 0.59 0.64 0.70 0.76 0.80 0.83 0.86 0.88 0.90 0 . S 3 0.96 0.98 
































































































drawn maps of station reports reveal the NMC maps to be systematically 
too smooth. 

In conclusion :',t can be stated that the 10%-15% difference 
in eddy available potential energy between SAT and NO SAT analyses 
is primarily due to the differences in the Aleutian and North Pacific 
regions. To determine which analysis is correct a detailed study of 
these areas would be necessary. On the other hand the GISS and NMC 
analyses differ by 25% to 50%; and there are differences all over 
the globe. The NMC analysis scheme seems to significantly under- 
estimate the energy in the atmosphere. This could be a significant 
source of error in NMC forecasts, if as Tracton and McPherson speculate 
(NMC office note 136), underestimation of the variance in the thermal 
structure of the atmosphere will act to the detriment of the analyses. 

5.4 IMPACT OF SATELLITE DATA ON PROGNOSTIC FLOW PATTERNS 
5.4.1 Statistical Comparisons (m. Haiem) 

Two statistical measures commonly employed to estimate the 
accuracy of forecasts are Si skill scores and rms differences in 
500mb heights and sea-level pressures. In the GISS experiments, the 
SAT and NO SAT forecasts made from the GISS analysis and forecasts 
cycle were validated against NMC's analysis over North America. Table 3 
shows the average impact for 11 separate forecasts spaced 2 days apart 
starting on February 1, for 48- and 72-hour sea-level pressure and 
500mb heights, in terms of SI scores and rms scores. The average 
impact in SI scores if found to be about 5 percent in 48 hours and 
7 percent in 72 hours for both quantities. RMS scores produce larger 
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Table 3 . Average 


Sea-Level Pressure 


500-mb Heights 


Statistical Impact Over North America 
February 1 to February 21, 1976. 


(11 Cases) , 


48 Hour 


72 Hour 


3-28 + l.Q (5%) i^ -j + 2.3 (6%) 

•97 + .3 (12%) 1-06 + .7 (in) 


1.91+1.1 (5%) 3.43 + 1 .3 (7%) 

5.1 + 3.1 (7%) 10.74 + 6 (11%) 




Skill score + Std. 
RMS Error + Std. E 


Err. (% impact) 
rr. (% impact) 


impacts on the order of 10 percent or more, respectively, for 
the same fields. The statistical error bounds indicate that the 
average impact is significant, being larger than twice the variance 
(a) for both the rms and skill score errors. Similar results with 
somewhat larger impacts occurred over Europe. Gonsideration of the 
results over Europe as an independent test region, the significance 
of the impact of these magnitudes would have a confidence probability 
of 99 percent. 

Although similar positive impacts were obtained in the summer 
DST-5 experiments, the question still arises whether or not the 
impact is a fluke or the result of real information content stemming 
from satellite data. It is conceivable that these results are 
statistical fluctuations produced by the four-dimensional assimila- 
tion and balancing cycle. In order to test such a conjecture another 
experiment was set up in which the satellite data was replaced by 
"fabricated" satellite data and maintained all other assimilation 
processes identical to the experiment described above. The "fabri- 
cated" data were generated from the 12-hour forecasts based on the 
NO SAT system. The forecasts were used to interpolate to the posi- 
tions of the satellite soundings and provide a temperature profile 
at all mandatory pressure levels corresponding to each satellite 
sounding that was available operationally during the test. The 
statistical bias, rms errors, and correlations were calculated for 
the differences between the original NESS soundings and the co- 
located radiosondes in a 3-hour window and 110-km region for each 
10® latitude belt and every mandatory level. Correlations were also 
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temperature 




calculated for the difference between the forecast 

and the radiosondes. Based on this pair of statistics, 
a random error and bias was added to the forecast profiles in order 
to generate "fabricated" sounding data having the identical sta- 
tistical error structures that were measured for the DST-6 satellite 
soundings at the same positions. In this way, a new sounding tape 
was generated so that an outside user receiving this data set 
could not tell from the statistical properties or yield, whether 
the soundings were "real" or "fabricated." 

These "fabricated" data were then fed into the control experi- 
ment and treated just as it was done in the case of the original 
sounding data. The forecast impacts for each of the 11 forecast 
periods are compared with the real-SAT system in Table 4. The 
largest positive impact in any forecast from the control experiment 
is a four-point SI score which establishes the random background 
noise level due to modification of the analyis scheme by satellite 
data and balancing. The average 500-mb impact at 72 hours for the 
"fabricated" data is -.14, while for the satellite data the net 
impact is 3.43. Similar results are shown in Table 4 for the sea- 
level pressure impact. Moreover, impacts of eight points or more 
occurred in the real system on February 3 and February 9, respective- 
ly, more than twice as large as anything produced in the control 
experiment. This experiment further confirms the conclusion that 
statistical impacts of this magnitude which seem to occur about one 
day in five are significantly above the random noise level. On 
other days the satellite soundings probably lie in the general realm 
of minor statistical fluctuations, although some might yet be 
significant. 
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Table 4 . 

Individual Skill 

Score Impacts Over North 

America (Winter - 

72 Hours) 


5Gi) MB 

Heights 

Sea Level 

Pressure 


2 SAT 

"Fabricated Data" 

2 SAT 

"Fabricated Data 

Date 

Impact 

Test 

Impact 

Test 

Feb. 1 

1 .8 

-3.5 

-4.9 

O 

• 

CVJ 

1 

3 

9.4 

3.4 

8.4 

4.7 

5 

-2.2 

0.8 

-0.3 

-2.8 

7 

0.7 

-1.1 

10.2 

0.3 

9 

7.8 

1.2 

13.5 

1.4 

n 

5.9 

-2.1 

16.4 

-1.2 

13 

6.8 

1.1 

10.5 

5.2 

15 

1.9 

-3.3 

1.5 

-3.7 

17 

-4.5 

-1.8 

-5.7 

-4.5 

19 

4.7 

3.9 

1 

ro 

• 

00 

5.8 

21 

• 

If) 

-0.9 

5.2 

-4.3 


3.43+1.3 , 

•-0.20+0.8 

4.73+2.3 

-1.01+1.6 


5.').2 Synoptic Comparisons 

5i4i2tl Forecast Differences (r. Atlas and w. Johnson) 


A synoptic evaluation of the forecasting impact of the 
satellite-derived sounding data was performed by directly comparing 
the prognostic charts generated from SAT and NO SAT initial condi- 
tions with each other and with the corresponding NMC analyses for 
verification. Comparisons were made every 12 hours for all of the 
prognostic fields which were described in Section 5.2.1. However 
only the sea-level pressure and 500-mb height fields at the end 
of each 72-hour forecast will be discussed here. 


Figures 19 to 40 depict the errors of the SAT and NO SAT 
sea-level pressure and 500 mb prognostic fields, as well as the 
differences between the SAT and NO SAT forecasts of these quanti- 
ties. The error maps, (a) and (b) in Figures 19 to 40, were obtained 
by subtracting the NO SAT and SAT forecasts respectively from the 
NMC analysis interpolated to the GISS grid. The difference maps 
(c) were obtained by subtracting the SAT forecast from the corres- 
ponding NO SAT forecast. Moderate to large impacts of the satellite 

data are evident on most of the difference maps, and are summarised 
in Table 5. 


This table was prepared by first noting the regions of moderate 
to large differences (8 mb or more at sea level or 96 meters or more 
at 500 mb) between the SAT and NO SAT prognostic fields, and then 
comparing the errors of each system in these regions. 
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From the table, it can be aeen that moderate to large fore- 
casting impacts occur in nine of the eleven cases and that 77» of 
these impacts are beneficial. As a result there is a 38-75% reduc- 
tion Of specific forecasting errors at 500 mb and a 40-100% reduction 
of specific errors in the sea level pressure forecast. It should 
be noted that these impacts refer only to the reduction of errors 
where the SAT and NO SAT prognoses are significantly different. 

The fact that these errors are reduced or increased (in the case 
of negative impacts) does not mean that the prognostic patterns 
have been significantly altered. In order to ascertain the predic- 
tive importance of the impact, it is necessary to compare the actual 
prognostic fields (rather than the difference plots) . In the next 
section two case studies, in which a significant improvement of the 
500 mb prognostic field occurred, will be presented. 

5. 4. 2. 2 Case Studies 

I: 72-hour Forecast from Feb. 9, OOZ 

This is a case in which a large positive impact is evident 
in the statistical scores or in the difference maps. Figure 34c 
shows that a large difference of 128 meters, between the NO SAT 
and SAT 500-mb forecasts, has occurred over the north central 
united States, while a comparison of Figures 34a and 34b reveals 
that this impact has resulted in a 50% reduction of the NO SAT 

500-mb height errors in this region. 

Figures 41 and 42 show the 72-hour 500-mb prognostic flow 
patterns for the NO SAT and SAT forecasts from February 9, respective 
ly, while the corresponding NMC analysis is shown in Figure 43 for 
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verification. In the surface maps (not shown here) a low-pressure 
system, accompanied by moderate snowfall, was located in lower 
Canada at 55®N, 120'»W (Alberta). A local forecaster, using the 
500-rab contour patterns depicted in Figure 41 to steer the surface 
low, would forecast this low-pressure system to move southeastward 
into the central United States plains and would probably predict 
moderate to heavy snow over this area. If the forecaster used the 
steering patterns depicted in Figure 42 instead, he would forecast 
the surface low to move toward the Great Lakes and predict the snow- 
fall to be further north along the border between the United States 
and Canada. The NMC analysis is in close agreement with the contour 
orientation of the SAT system and indeed the surface low and its 
associated snowfall did stay further north. The significant bene- 
ficial impact that is evident in this 500-mb contour pattern is also 
evident in the lower levels of the atmosphere (not shown) , and it 
appears obvious that the inclusion of satellite data can result in 
decidedly different weather forecasts for large regions. 

II; 72-hour Forecast From Feb. 19, OOZ 

This second case is one in which a significant difference in 
the prognostic pattern occurred even though a large statistical impact 
did not result. Figure 39c reveals that a large impact of 128 meters 
at 500 mb has occurred over the southwest United States while smaller 
differences exist elsewhere. From Figures 39a and 39b, it can be 
seen that this impact resulted in a 57% reduction of the NO SAT 500-mb 
height errors in this region. 

Figures 44 and 45 depict the 72 hour 500-mb prognostic charts 
from February 19 for NO SAT and SAT cases respectively. The 
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corresponding NMC analysis is depicted in Figure 46. A comparison 
of these three charts reveals that the NO SAT prog is considerably 
slow in its movement of a trough into the midwest and a ridge off 
the east coast whereas both of these systems are displaced further 
east and in better agreement with the analysis in the SAT case. 


ORIGINAL PAGE IS 
OF POOR QUALITY 



figure 19a. 72-Hour 
Sea-Level Pressure NO 
SAT Error Map from 
February 1 OOZ Initial 
Conditions . 
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Figure 19b. 72-Hour 
SAT Error Map from 
February 1 OOZ Initial 
Conditions . 


Figure 19c. 72-Hour 
NO SAT-SAT Difference 
Map from February 1 OOZ 
Initial Conditions. 
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Figure 20a. 72-Hour 
Sea-Level Pressure NO 
SAT Frror Map from 
February 3 OOZ Initial 
Conditions . 


Figure 20b. 72"-Hour 
SAT Error Map from 
February' 3 OOZ InitJnl 
Conditions. 


Figure 20c. 72-Hour 
NO SAT-SAT Difference 
Map from February 3 OOZ 
Initial Conditions. 
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Figure 21a. 72-Hour 
Sea-Level Pressure NO 
SAT Error flap from 
February 5 OOZ Initial 
Conditions. 


Figure 21b. 72-Hour 
] SAT Error Map from 
February 5 OOZ Initial 
Conditions. 


laiK 








( MM 




Figure 21c. 72-Hour 
^.NO SAT-SAT Difference 
-J Map from February' 5 oOZ 
I Initial Conditions. 




Figure 22a. 72-Hour 
Sea-Level Pressure NO 
SAT Error Map froir 
February 7 OOZ Initial 
Conditions. 
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Figure 23a. 72-Hour 
Sea-Level Pressure 
NO SAT Error Map from 
Februairy 9 OOZ Initial 
Conditions. 


figure 23b. 72-Hour 
SAT Error Map from 
February 9 OOZ Initial 
Conditions. 


Figure 23c. 72-Hour NO 
SAT-SAT Difference Map 
0 ."^ from reoruarv' 0 OOZ 
t Initial Conditions. 







ri^re 24a. 72-Hour 
Sea-I.pvel Pressure 
NO SAT Error Map from 
February 11 OOZ 
Initial Conditions. 


Figure 24b. 72-Hour 
SAT Error Map from 
February 11 OOZ 
Initial Conditions. 


Figure 24c. 72-llour 
NO SAT-SAT Difference 
Map from February 11 
OOZ Initial Conditions 






original Pacu 

OF P,X,R 


Figure 25a. 72-Hour 
Sea-Level Pressure 
NO SAT Error Mao from 
February 13 002 
Initial Conditions. 


Figure 25b. 72-Hour 
SAT Error Map from 
February 13 002 
Initial Conditions. 


Figure 25c. 72-Hour NO 
SAT-SAT Difference Map 
from February 13 002 
Initial Conditions. 





Figure 26a. 72-Hour 
Sea-Level Pressure 
NO SAT Error Map from 
February 15 OOZ Initial 
Cond< tions. 


Figure 26b. 72-Hour 
SAT Error Map from 
February 15 OOZ Initial 
Conditions . 


Figure 26c. 72-Hour UO 
5AT-SAT Difference Map 
from February 15 OOZ 
Initial Conditions. 
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Figure 27a. 72-Hour 
Sea-Level Pressure 
NO SAT Error Map from 
February 17 OOZ Initial 
Conditions. 


Figure 27b. 72-Hour 
SAT Error Hap from 
February 17 OOZ Initial 
Conditions. 


Figure 27c. 72-Hour NO 
SAT-SAT Difference Map 
from February 17 OOZ 
Initial Conditions. 







figure 28a. 72-Hour 
Sea-I.evel Pressure 
NO SAT Error Mao from 
February 19 OOZ Initial 
Conditions. 


Figure 28b. 72-Hour 
SAT Error Fap from 
February 19 OOZ Initial 
Comlitions . 


Figure 28c. 72-Hour 'JO 
SAT-SAT Difference Map 
from February 19 OOZ 
Initial Conditions. 
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Figure 29a. 72-Hour 
Sea-Level Pressure 
NO SAT Error Map from 
February 21 OOZ Initial 
Conditions. 


Figure 29b. 72-Hour 
SAT Error Map from 
February 21 OOZ Initial 
Conditions. 


Figure 29c. 72-Hour NO 
SAT- SAT Difference ':ap 
from February 21 OOZ 
llnitial Conditions. 
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Figure 30a. 7?.-Hour 
500 mb NO SAT Error : 
from February 1 OOF. 
Initial Conditions. 


Figure 30b. 72- Hour 

SAT Error Map from 
February 1 OOZ Initial 
Conditions . 


Figure 30c. 72-Hour NO 
SAT-SAT Difference Map 
from February’ 1 OOZ 
Initial Conditions. 
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V.<ynr<^ <] •• 71- Hi>nr 

500 NO Si I Ernjr r-np 
£ix>tn Fohruary 3 OUZ 
TT'i.tipl ronciitloas. 






Figure 32a. 72-Hour 
500 mb NO SAT Error 
Map from February 5 OOZ 
Initial Conditions. 


Figure 32b. 72-Hour 
SAT Error Map from 
February 5 OOZ Initial 
Conditions . 


Figure 32c. 72-Hour NO 
SAT- SAT Difference Map 
from February 5 OOZ 
Initial Conditions. 
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Fiquro 33a. 72-Hour 
500 i0> NO SAT Error Map 
from Fobruary 7 OOZ 
Initial Conditions. 



1 - 

• 


" f t' 

; ' ■*<'] 

1 ^ \ 

''C ^ 

. , A . 

> t I 

f i 

♦ft) ' 

i 

i" j 

- ^ 

^ i 

i, ! 

: • 'J 

~T 

1 "i 

: « 1 


Figure 33b. 72-Hour 
SAT Error Map from 
February 7 OOZ Initial 
Conditions. 



Figure 33c. 72-Hour NO 
SAT-SAT Difference Map 
from February 7 OOZ 
Initial Conditions. 
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Figure 34a. 72-Hour 
500 nb NO SAT Error Map 
from February 9 OOZ 
Initial Conditions. 


Figure 34b. 72- Hour 

SAT Error Man from 
February 9 OOZ Initial 
Conditions. 


Figure 34c. 72-Hour NO 
SAT-SAT Difference Map 
from February 9 OOZ 
Initial Conditions. 





lginal 

POOR QUAU^* 


Lgure 35a. 72-Hour 
)0 mb NO SAT Error Map 
:om February 11 OOZ 
litial Conditions. 


.gure 35b. 72-Hour 
iT Error rap from 
ibruary 11 OOZ Initial 
inditions . 


Figure 35c. 72-Hour NO 
SAT-SAT Difference Map 
from February 11 OOZ 
Initial Conditions. 







Figure 36a. 72-Hour 
500 mb NO SAT Error Map 
from February 13 OOZ 
Initial Conditions. 


Figure 36b. 72-Hou.’. 

SAT Error Map from 
February 13 OOZ Initial 
Conditions. 


Figure 36c. 72-Hour NO 
SAT-SAT Difference Jlap 
from February 13 002 
Initial Conditions. 








Figure 37b. 72-Hour 
f?AT Error Map from 
February 15 OOZ Initial 
Conditions. 


Figure 37c. 72-Hour NO 
SAT-SAT Difference Mao 
from February 15 OOZ 
Initial Conditions. 
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'igure 37a. 72-Hour 
>00 mb NO SAT Error Map 
from February 15 OOZ 
Initial Conditions. 






Figure 38a. 72-Hour 
500 mb NO SAT Error 
from February 17 OOZ 
Initial Conditions. 


^Figure 38b. 72-Hour 
SAT Error Map from 
■•'rbruary 17 OOZ Initial 
.Conditions. 


Figure 38c. 72-Hour NO 
SAT-SAT Difference Mao 
from February 17 OOZ 
Initial Conditions. 









Figure 39a. 72-Hour 
500 mb NO SAT Error ! 
from February 19 OOZ 
Initial Conditions. 


Figure 39b. 72-Hour 
SAT Error Map from 
February 19 OOZ Initial 
Conditions. 


Figure 39c. 72-Hour NO 
SAT-SAT Difference Map 
from February 19 OOZ 
Initial Conditions. 
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Figure 40a. 72-Hour 
500 mb NO SAT Error 
Map from February 21 
OOZ Initial Condi- 
tions . 


Figure 40b. 72-Hour 
SAT Error Map from 
February 21 OOZ 
Initial Conditions. 


Figure 40c. 72-Hour 
NO SAT- SAT Difference 
Map from February 21 
OOZ Initial Conditions 
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Table 5. 


Sununary of Regional 72-hr Forecast 
Over North America 


Impacts* 


A) Sea Level Pressure 


Forecast from Beneficial Impacts 

(in mb) 


Percent Correction 
of error 


Feb 1 
3 
3 
5 
7 
9 
9 

11 

13 

19 

21 


+12 
+ 8 
+16 


60% 

40% 

80% 


+16 
+ 16 
+ 8 
+12 
+ 8 
+ 8 
+ 8 


67% 

57% 

50% 

46% 

50% 

100 % 

67% 


B) 500mb 

Forecast from 


Feb 1 
3 
5 
7 
9 

11 

13 

19 

21 


Beneficial Impacts 
(in mb) 


+160 
+ 96 

+128 
+ 96 
+ 96 
+128 
+ 96 


Percent Correction 
of error 


56% 

50% 

50% 

60% 

75% 

57% 

38% 


or lar,L'at 500^haTC‘bnn"iTClSI|d!®''®‘ 


Negative 
Impacts 
(in mb) 

-12 


- 8 
-16 


Negative 
Impacts 
(in meters) 

-96 


-160 
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Figure 43 
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5.5 IMPACT OF SATELLITE DATA ON ACTUAL WEATHER FORECASTS 

The ultxmate objective in the evaluation of the impact of 
satellite data is to determine what it means in terms of the 
accuracy of the actual weather predictions that might be issued 
by a local weather forecaster. In order to assess this impact, 
the computerized forecasting model (CFM) was applied to the direct 
prognostic output from the GISS model for the DST-6 period. CFM 
local precipitation forecasts were generated from the eleven test 
periods for both the SAT and NO SAT systems for 128 cities 

uniformly distributed over the United States. 

Ij 

Comparisons ot city" precipitation forecasts for these cities 
are presented in Table 6. The total number Of correct pre- 
cipitation forecasts for the SAT and NO SAT systems are shown only 
for those cases in which the two systems gave rise to different 
forecasts. The systems differed over all cities in about 10 percent 
of all forecasts and these results cover cases when at least one 
system forecasts a precipitation event. The total number of 
diff®i^snt forecasts for each day is shown for 128 cities in the 
lower horizontal row. In 24 and 48 hours there is a 12 percent 
improvement in the SAT system, while in 72 hours the forecast im- 
provement was 19 percent. Upon examination of a separate list of cities 
in the midwest selected because they are not influenced as much by 
coastal effects, mountains, or the warmer gulf convective systems, 
better than a two to one improvement in forecasting is seen for the 24 
and 72 hours and a surprising eleven-fold improvement in 48 hours. 
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Table 6 


CITY PRECIPITATION FORECAST 


2A HR A8 HR 72 HR 



"Sat" 

Better 

"No Sat" 
Better 

"Sat" 

Better 

"No Sat" 
Better 

"Sat" 

Better 

"No Sat 
Better 

MID WEST 

11 

4 

11 

1 

7 

3 

(17) 







ALL US CITIES 

82 

64 

68 

53 

85 

' 58 

(128) 








Daily examination of city forecast accuracies, as shown in Table 7 
for specific forecasts such as those on February 9 or February 19, 
show major Improrements in the 48 and 72 hour precipitation forecasts. 
Only on February 15 does a serious negative impact occur in 72 hours. 
This Indicates that the increased accuracies in skill scores on a 
daily basis correlate well with improvements in local weather fore- 
casts. However, such improvements can even occur in modest skill 
score impacts. 

5.6 CONCLUSIONS AND RECOmENDATIONS (R. Atlas and M. Halem) 

The impact of satellite derived temperature measurements on 
medium-range (one to three day) weather forecasting was evaluated 

for eleven forecasts over a three-week winter period with regard 
to the following criteria: 

(1) Magnitudes and locations of initial-state differences in 
the analyzed fields produced with and without .satellxte data ; 

(2) Statistical measures of forecast accuracy (i.e., Sl-skill 
scores and rms errors) obtained from numerical integrations starting 
from these initial states prepared with and without satellite data; 

(3) Subjective comparisons of the usefulness and accuracy of 
prognostic charts generated from these initial states; 

(4) Verifications of precipitation forecasts as might be 
issued in local forecast operations based on forecast outputs with 
and without satellite data. 
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Table 7 


PRECIPITATION FORECAST OVER 128 CITIES 
WINTER 1976 



48 HOUR FORECASTS 


72 HOUR FORECASTS 


'NO SAT' 

'SAT' 

'NO SAT' 

'SAT' 

DATE 

BETTER 

BETTER 

BETTER 

BEHER 

Feb 1 

4 

1 

6 

3 

3 

14 

2 

7 

8 

5 

4 

3 

5 

7 

7 

7 

6 

4 

7 

9 

2 

18 

8 

17 

il 

5 

13 

0 

3 

13 

0 

4 

3 

5 

15 

7 

10 

16 

8 

17 

6 

4 

3 

5 

19 

2 

5 

3 

21 

21 

2 

2 

3 

1 

TOTALS 

53 

68 

58 

85 


The impact was assessed tor a combination of operational and 
experimental temperature sounders providing continuous coverage from 
two satellites, NOAA ^ and Nimbus 6. The impact of sounding data was 
found to be beneficial but modest for all the criteria listed above 
for the limited sample of cases examined in this study. Over the 
data—sparse regions, the magnitudes of the initial— state differences 

from day to day were generally large (90-120 meters in the 500-mb 
heights) , while the average impact in skill scores and rms errors 
showed a 5-10 percent statistical improvement resulting from 
satellite data. The prognostic charts used in the precipitation 
forecasts showed many examples of better verifications 
of sea- level pressure and 500-mb heights. Actual precipitation fore- 
casts made tor specific cities were more favorable in 15 percent of 
the cases in which the forecasts for the two systems were substantially 
In particular, over the mid-west there was a striking 
improvement in precipitation forecasting. 

A substantial positive impact (20 percent for SI scores 
and 30 percent or more for rms scores) occurred in a number of 
cases but a longer sequence of impact tests is needed to establish 
whether they are related to weather systems periodically missed in 
data-sparse regions. Furthermore, the experiments also confirm 
earlier simulation studies reported by GISS that soundings from 
a two-satellite system providing nearly continuous 6 hour coverage 
will produce larger and more consistently positive impacts than a 
single-satellite sounding system with twelve hour coverage. 
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The findings in this experiment are based on the global DST- 
data sets that have been jointly collected and processed by NOAA 
and NASA in a quasi-operational real-time test mode. The assimila- 
tion techniques developed and employed by GISS for this systems 
test are applicable operational forecasting pr'actices. If these 
procedures were xntroduced into operational forecasting today, 
satellite sounding data of this quality and coverage might 
yield improvements of similar magnitudes . 

The major limitations of this study have been the small 
number of cases studied and the inaccuracies of the forecast model. 
In order to rectify this situation additional cases are currently 
being generated and will be evaluated when available. In addition, 
the entire sample of cases will be re-evaluated utilizing the 
ultrafine version of the GISS model. 

Additional modification to our evaluation systems are also 
being made. These include: 

(1) Statistical measures of the variance and eddy energy of 
analyses produced with and without the inclusion of satellite data; 

(2) Extension of the predictive capabilities of the CFM 
to include surface temperature change, convective precipitation, 
and quantitative precipitation amounts. 


